-- Logs begin at Mon 2022-09-19 10:31:19 UTC, end at Mon 2022-09-19 11:31:41 UTC. -- Sep 19 10:59:34.754022 dv-cinder-822822-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 19 10:59:34.765540 dv-cinder-822822-7-smb devstack@keystone.service[81538]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 10:59:34 2022] *** Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: nodename: dv-cinder-822822-7-smb Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: machine: x86_64 Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: clock source: unix Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: pcre jit disabled Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: detected number of CPU cores: 4 Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: current working directory: / Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: detected binary path: /usr/bin/uwsgi-core Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: your processes number limit is 47680 Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: your memory page size is 4096 bytes Sep 19 10:59:34.767601 dv-cinder-822822-7-smb devstack@keystone.service[81538]: detected max file descriptor number: 2048 Sep 19 10:59:34.768310 dv-cinder-822822-7-smb devstack@keystone.service[81538]: lock engine: pthread robust mutexes Sep 19 10:59:34.768310 dv-cinder-822822-7-smb devstack@keystone.service[81538]: thunder lock: enabled Sep 19 10:59:34.768310 dv-cinder-822822-7-smb devstack@keystone.service[81538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 19 10:59:34.768310 dv-cinder-822822-7-smb devstack@keystone.service[81538]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 10:59:34.806862 dv-cinder-822822-7-smb devstack@keystone.service[81538]: Python main interpreter initialized at 0x556a7bfc49c0 Sep 19 10:59:34.806862 dv-cinder-822822-7-smb devstack@keystone.service[81538]: python threads support enabled Sep 19 10:59:34.806862 dv-cinder-822822-7-smb devstack@keystone.service[81538]: your server socket listen backlog is limited to 100 connections Sep 19 10:59:34.806862 dv-cinder-822822-7-smb devstack@keystone.service[81538]: your mercy for graceful operations on workers is 90 seconds Sep 19 10:59:34.807310 dv-cinder-822822-7-smb devstack@keystone.service[81538]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 10:59:34.807393 dv-cinder-822822-7-smb devstack@keystone.service[81538]: *** Operational MODE: preforking *** Sep 19 10:59:34.807615 dv-cinder-822822-7-smb devstack@keystone.service[81538]: *** uWSGI is running in multiple interpreter mode *** Sep 19 10:59:34.807615 dv-cinder-822822-7-smb devstack@keystone.service[81538]: spawned uWSGI master process (pid: 81538) Sep 19 10:59:34.807831 dv-cinder-822822-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 19 10:59:34.812417 dv-cinder-822822-7-smb devstack@keystone.service[81538]: spawned uWSGI worker 1 (pid: 81548, cores: 1) Sep 19 10:59:34.812417 dv-cinder-822822-7-smb devstack@keystone.service[81538]: spawned uWSGI worker 2 (pid: 81549, cores: 1) Sep 19 10:59:34.812417 dv-cinder-822822-7-smb devstack@keystone.service[81538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 10:59:39.161801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:59:39.161801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: from cryptography.utils import int_from_bytes Sep 19 10:59:39.162615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:59:39.162615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: from cryptography.utils import int_from_bytes Sep 19 10:59:39.163026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:59:39.163026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: from cryptography.utils import int_from_bytes Sep 19 10:59:39.163136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:59:39.163136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: from cryptography.utils import int_from_bytes Sep 19 10:59:39.212865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:59:39.213059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:59:39.213150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:59:39.213236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:59:39.213315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] command line args: [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:59:39.213380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] command line args: [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:59:39.213499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:59:39.213589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:59:39.213684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ================================================================================ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:59:39.213770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ================================================================================ {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:59:39.213943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] admin_token = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] admin_token = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] config_dir = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_dir = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] config_source = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] config_source = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] debug = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] debug = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.214902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.215954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_config_append = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_config_append = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_dir = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_dir = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.216969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_file = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.217589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.217741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.217820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.217968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.218951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.219923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.220854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.221870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] publish_errors = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] publish_errors = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.222890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] standard_threads = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] standard_threads = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.223923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_journal = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_json = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] use_journal = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] use_json = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_stderr = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] use_stderr = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] use_syslog = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] use_syslog = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:59:39.224892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.225905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.226969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.227988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.228874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.229998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.230899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.231848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.232771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.233417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.233601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.233681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.233885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.234906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.235857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236171 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.236968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.237986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.238923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.239979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.240953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.241992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.242957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.243925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.244871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.245937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.246991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.247935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.248821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.249994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.250986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.external = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.251965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.external = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.password = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] auth.token = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.252932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.password = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] auth.token = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.253966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.254973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.255869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.256843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.257831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.258963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.259930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.260973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.261926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.262854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.263993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.264987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.265986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.266983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.267955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.268941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.269904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.270914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.271993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.272916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.273957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.274883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.275953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.276862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.277849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.278939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.279011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.280968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.281974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.282945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.283927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.284963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.286668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.286883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] role.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] role.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.287930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.288964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.289966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.290876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.291999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.292946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.293967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.294907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.295061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.295278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.295911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.296840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.297976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.298964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.connection = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.299950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.300984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.301932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.302929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:59:39.303001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.303257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.303488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.303725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.303961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:59:39.304126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:59:39.332866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.333098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.333328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.333614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.333845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.334070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.341837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.343144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.371475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.371676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.371770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.371908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.426408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.426571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.477298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.477489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.477633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.477743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.636404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.636596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.636742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.636825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.636928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.637531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.660971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.661938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.662064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.662151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.662275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.662368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.674431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.674613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.687933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.688981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.689061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.689169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81548) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.689254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.689381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81549) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 19 10:59:39.706888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.707039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.707130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:59:39.707281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:59:39.707451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.707630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.707715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:59:39.707837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 19 10:59:39.707920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.708894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.718551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.718785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.718877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.719135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.719293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.719392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.719472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.719644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.726353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.726693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.729287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.729569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.729655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.729851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.729936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.730947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.731601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.731725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.731870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.732483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.756133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.756329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.757692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.757846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.757930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.758147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.762599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.762929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.763024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.763174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.763306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.763536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.770412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.770586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.770699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.770880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.776520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.776716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.776812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.777971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.778162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.778254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.778431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.778514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.778700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.794903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.795215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.795331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.795502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.799370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.799515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.802592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.802744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.802889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.803042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.807115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.807321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.810295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.810495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.813769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.814752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.815232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.815319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.815519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.815610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.815817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.832311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.832311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.832603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.832700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.832866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.832969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.833223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.833486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.839822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.840398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.841387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.841941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.843067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.843371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.843857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.844134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.846062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.846353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.846648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.846846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.846930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.847129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.847350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.847435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.847716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.848104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.858731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.859015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.859338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.859625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.859709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.859938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.860881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.861181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.861459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.876725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.877759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.879713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.880710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.882837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.883636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.884322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.885080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.885814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.886102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.886504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.886586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.886816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.887322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.893624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.894645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.895111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.896145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.898044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.898446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.898736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.899015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.899099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.899435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.899726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.900006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.906986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.907304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.907593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.908217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.908509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.908793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.914591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81549) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.914881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.915190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.915478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.915759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.915850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81548) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 19 10:59:39.916045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.916964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.917142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.917227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.917418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81549) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.918992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.919273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81548) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 19 10:59:39.954181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a7bfc49c0 pid: 81549 (default app) Sep 19 10:59:39.955864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a7bfc49c0 pid: 81548 (default app) Sep 19 10:59:39.957554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752606-d992-420c-bab4-5ff97036270c None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:39.957844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752606-d992-420c-bab4-5ff97036270c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:39.958119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752606-d992-420c-bab4-5ff97036270c None None] PATH_INFO: `/v3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:39.962308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Sep 19 10:59:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:46.848965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:46.849484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:46.849592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:46.853775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:59:46.859937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:46.860357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:46.860491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:46.932007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: INFO dbcounter [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] Registered counter for database keystone Sep 19 10:59:46.952363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG oslo_db.sqlalchemy.engines [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:59:46.958684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writer thread running {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:59:47.140575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG passlib.handlers.bcrypt [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81549) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 10:59:47.141012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG passlib.handlers.bcrypt [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81549) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 10:59:47.199447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:47.201072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:47.332649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 10:59:47.792666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:47.865628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: INFO dbcounter [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] Registered counter for database keystone Sep 19 10:59:47.887810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG oslo_db.sqlalchemy.engines [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:59:47.894979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writer thread running {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:59:48.016350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268f91e-e75d-46ba-a41e-1360b4f61fe2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:48.020674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:48.021308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:48.021592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:48.021868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:48.030636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:48.083478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 10:59:48.083754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af9e3f-e9c1-4af7-a70f-94a7187aef6b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:48.094495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Sep 19 10:59:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:59:48.100565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:48.117436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fc616-7625-408b-bb4a-3a3a615dea4a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:48.121933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:48.123640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:48.123961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:48.124232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] PATH_INFO: `/v3/projects/ba438247ac1f43808755e10d7725b064` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:48.125914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] RBAC: Authorizing `identity:get_project(project_id=ba438247ac1f43808755e10d7725b064)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:48.178626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 19 10:59:48.178970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5cfbbf-ae3e-4b28-b76f-e70f42b88172 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:48.183590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Sep 19 10:59:48 2022] GET /identity/v3/projects/ba438247ac1f43808755e10d7725b064 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:50.340797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806e55-88ad-4351-a585-4ee086356921 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:50.341297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806e55-88ad-4351-a585-4ee086356921 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:50.341478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6806e55-88ad-4351-a585-4ee086356921 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:50.346032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:50.351571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:50.351978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:50.352132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:50.372924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:50.374624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:50.382574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 19 10:59:50.650986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6806e55-88ad-4351-a585-4ee086356921 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:50.663555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6806e55-88ad-4351-a585-4ee086356921 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:50.667723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:50.668318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:50.668599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:50.668870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:50.677005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:50.678775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10792844-dfba-4b30-a996-2e6d2adfd60d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:50.687429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Sep 19 10:59:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 10:59:50.693168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:50.702930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692befa-f63c-4b29-a5b7-f21dfdadfabd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:50.707327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:50.707953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:50.708231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:50.708500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:50.709809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:50.711682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11225aa0-5bf1-464f-8314-6f2ccdc2da74 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:50.713192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Sep 19 10:59:50 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:52.944393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42791-953d-4958-ad2c-c290043d9c64 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:52.944939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42791-953d-4958-ad2c-c290043d9c64 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:52.944939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42791-953d-4958-ad2c-c290043d9c64 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:52.946263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:52.952615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:52.953057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:52.953150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:52.972050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:52.973238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:52.976528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224a6ac-56eb-44c7-8d47-2b379469f700 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:52.976877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224a6ac-56eb-44c7-8d47-2b379469f700 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:52.977212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224a6ac-56eb-44c7-8d47-2b379469f700 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:52.978578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:59:52.983946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:52.984231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:52.984505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.026857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG passlib.handlers.bcrypt [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81548) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 19 10:59:53.027276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG passlib.handlers.bcrypt [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81548) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 19 10:59:53.057332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:59:53.077270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:53.078887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:53.178840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:59:53.327810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.352927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:53.437629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323c782-0c0e-4f90-8a97-de4b02495535 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.447005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.472269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.472912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.473191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.473466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.484871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:59:53.493943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:59:53.495049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 10:59:53.495950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:59:53.501452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.552331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3c6cb-7439-45ee-8d63-2e9a5363eae3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.554561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:53.585778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:53.592081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.592965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.593255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.593524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.604618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed107ce1-a9a2-4d0a-9971-cdcae9b055d3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.638630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.639874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.640154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.640430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.641091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:59:53.641392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:53.642828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:53.654949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:53.660646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.662311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:53.668775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:53.770889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d65aa-e299-46b4-a2a1-5ac652822b77 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.772065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 10:59:53.777807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.781603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:53.806294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.806861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.807142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.807442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.808589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:53.810047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:53.812209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:53.817909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.833134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:53.878960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dc847-f98a-418f-b0f5-53f2921dc69d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.913536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.914408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.914693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.914975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.918230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31f97d-d660-4542-9af6-4b216432ef31 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:53.936737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:53.938209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:53.955626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:53.956396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:53.956679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:53.956955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:53.958087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:59:53.958411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:59:53.959624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:59:53.960434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:59:53.960434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:59:53.960434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 10:59:53.960596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:53.960984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:59:53.961269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:53.965430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:53.966543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:54.025332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:54.049256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:54.069007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf722a-24af-4af3-8115-c9f025d5954a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:54.072722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbc864-3fa8-4349-b8c6-aee76a74516d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:54.103265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:54.103875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:54.104149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:54.104417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:54.105194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.domain.id=default, user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:59:54.105439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:54.106922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ac45f3-1ce3-400d-ae7b-bf694e22ef7a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:54.108280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:54.108899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:54.109184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:54.109462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:54.110103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:59:54.110408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:54.111833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad34f8-cbd6-4616-9afb-513cb7afccf6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:54.113560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/role_assignments?user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b&scope.domain.id=default&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:54.131381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:56.665085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6a506-8fa0-400b-a17a-c2bfe4932abd None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:56.665639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6a506-8fa0-400b-a17a-c2bfe4932abd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:56.665639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6a506-8fa0-400b-a17a-c2bfe4932abd None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:56.667266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:59:56.681183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db1c9-faef-4d92-8d78-b9cea95aecc5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:56.681723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db1c9-faef-4d92-8d78-b9cea95aecc5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:56.681723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db1c9-faef-4d92-8d78-b9cea95aecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:56.709172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-290db1c9-faef-4d92-8d78-b9cea95aecc5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:56.710396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-290db1c9-faef-4d92-8d78-b9cea95aecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:56.774128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e142-3a3d-4d31-85d7-057b351ed857 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:56.774882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e142-3a3d-4d31-85d7-057b351ed857 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:56.775231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e142-3a3d-4d31-85d7-057b351ed857 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:56.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 10:59:56.796212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2314-a1c2-4b73-aa2e-7dccad7eb011 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:56.796826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2314-a1c2-4b73-aa2e-7dccad7eb011 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:56.797307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa2314-a1c2-4b73-aa2e-7dccad7eb011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:56.804797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:59:56.830206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-acaa2314-a1c2-4b73-aa2e-7dccad7eb011 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:56.831765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-acaa2314-a1c2-4b73-aa2e-7dccad7eb011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:56.961548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:59:57.075733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933892c1-ca60-414a-bd9e-545f9f96efb0 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.076682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933892c1-ca60-414a-bd9e-545f9f96efb0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.076898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933892c1-ca60-414a-bd9e-545f9f96efb0 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.078510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 12/26] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:57.092580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3348-260f-4b6d-aeac-f0a0e24d91f5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.093152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3348-260f-4b6d-aeac-f0a0e24d91f5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.093655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a3348-260f-4b6d-aeac-f0a0e24d91f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.120161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b98a3348-260f-4b6d-aeac-f0a0e24d91f5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:57.121681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b98a3348-260f-4b6d-aeac-f0a0e24d91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:57.207872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933892c1-ca60-414a-bd9e-545f9f96efb0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:57.223075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:59:57.276210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:57.364881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933892c1-ca60-414a-bd9e-545f9f96efb0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:57.368006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3edef-7d62-4393-82b8-dce4fa4abaa2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.368553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3edef-7d62-4393-82b8-dce4fa4abaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.369044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3edef-7d62-4393-82b8-dce4fa4abaa2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.370850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 16/28] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:57.376538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.377129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.377691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.395140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:57.416222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:57.417764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:57.432472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:57.433133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.433389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.433661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.460315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 10:59:57.468344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:59:57.469235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 10:59:57.470008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 10:59:57.483329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 13/29] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 10:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 10:59:57.484563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:57.546342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:59:57.556648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:57.651933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e97e2-6e69-4b87-8fc2-d58aaeb26b7f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:57.659381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:57.716548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:57.718126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.718426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.718705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.719406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:59:57.719704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:57.721105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:57.747712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 14/31] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 10:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:57.749635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:57.752626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9238ba-5d08-4196-88ee-25da993b7c67 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:57.795225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:57.796407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.797366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.798460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.819833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:57.826381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:57.827467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 10:59:57.849783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 10:59:57.850865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 10:59:57.851863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 10:59:57.851863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 10:59:57.851863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 10:59:57.853646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 10:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 10:59:57.854625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:57.937033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1dfd-87c6-4ee8-a4a3-3e08bd71305d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:57.976980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:57.977607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:57.977892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:57.978484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:57.978937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:57.980472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:57.989553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f361229-7c01-4754-8eb0-e764d335400e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.029789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.031028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.031472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.031885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.033272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.035085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.037319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 19/33] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 10:59:57 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:58.038418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:58.102014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:58.119147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 15/34] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 19 10:59:57 2022] POST /identity/v3/roles => generated 219 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:59:58.119961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:58.157583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:58.169386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7be28b-53a8-4a4e-85f6-670fe2ea206e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.247305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc355-667e-4a82-9246-8956a4894f2f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.265305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.265941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.266222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.266914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.267182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 10:59:58.267494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.268974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.299000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.299668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.299948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.300223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.300906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.307679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.324054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 20/35] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 10:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:58.325017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:58.337160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 16/36] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 19 10:59:58 2022] POST /identity/v3/roles => generated 225 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:59:58.338277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:58.480311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e88ad6-aba5-4d69-87af-cbb52ecf23dd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.515589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:58.530829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.531582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.531923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.532220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.533841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.535628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.538069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 21/37] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 10:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 10:59:58.544511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:58.599144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:58.621491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5abd8-8ffa-4e1d-a386-6bbeb448c195 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.672893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.673640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.673923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.674199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.675139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.677237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52844d3-774c-416a-875a-2abd987870e6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.678439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be4424-cf5a-4ee6-84c3-d81ce62c3edd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:58.711631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 17/38] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 10:59:58 2022] POST /identity/v3/projects => generated 301 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:59:58.713100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb4fb-502a-4a44-92db-c1478bcebd44 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.713391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb4fb-502a-4a44-92db-c1478bcebd44 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.713664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfb4fb-502a-4a44-92db-c1478bcebd44 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.714896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 18/39] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:58.716010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b10-b9b8-491a-89ed-6b09c497da88 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.716360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b10-b9b8-491a-89ed-6b09c497da88 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.717169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11146b10-b9b8-491a-89ed-6b09c497da88 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.723312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 19/40] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 10:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 10:59:58.723312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bddd61-65d2-4a3b-b3a1-ccbcd75daa1a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.723312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bddd61-65d2-4a3b-b3a1-ccbcd75daa1a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.723312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bddd61-65d2-4a3b-b3a1-ccbcd75daa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.726789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:58.727615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.727910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.728165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] PATH_INFO: `/v3/domains/default/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.730268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:58.731852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:58.744776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-49bddd61-65d2-4a3b-b3a1-ccbcd75daa1a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:58.746719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-49bddd61-65d2-4a3b-b3a1-ccbcd75daa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:58.824364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 20/41] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 10:59:58.826128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:58.826813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:58.827384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:58.855441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 10:59:58.857273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 10:59:58.955455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:58.962678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 10:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 10:59:58.966443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1361 bytes} [Mon Sep 19 10:59:58 2022] PUT /identity/v3/domains/default/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 10:59:59.117363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:59.226917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca581-6579-43b7-8427-53ae9374ff43 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:59.243039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:59.267218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:59.267850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:59.268135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:59.268407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:59.269097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:59.270498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:59.290409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 22/44] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 19 10:59:59 2022] POST /identity/v3/roles => generated 223 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 10:59:59.300730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:59.371857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a04a-7c65-4c58-9ed5-9439b66d6a37 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:59.411710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:59.412374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:59.412662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:59.412943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:59.414278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:59.416072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c306f-2bf9-4b4d-9438-f225aa081caa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:59.422278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 10:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 10:59:59.426867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 10:59:59.497060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:59:59.542272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5fcab-733f-4afd-87ba-ccd7a423b1ae None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 10:59:59.576913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 10:59:59.577529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 10:59:59.577812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 10:59:59.578088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 10:59:59.578746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 10:59:59.580247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85504e1-b56a-415d-b399-6294593cdd38 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 10:59:59.606739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 10:59:59 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:01.180387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1a41-15a5-4759-92c2-fecf838bfdec None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.180941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1a41-15a5-4759-92c2-fecf838bfdec None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.180941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d1a41-15a5-4759-92c2-fecf838bfdec None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.182293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:01.189138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.189601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.189691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.208664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:01.209849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:01.279646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:01.551322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d1a41-15a5-4759-92c2-fecf838bfdec None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:01.657309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d1a41-15a5-4759-92c2-fecf838bfdec None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:01.669925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:01.695583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:01.696207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.696484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.696757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.706962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b60dcc77-9651-481e-8dc7-90712769b01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:01.711945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:01.712785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:01.713567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:01.719591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:01.767730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:01.781995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb7329-564e-4dd3-bc87-12aafa07cad7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.781995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb7329-564e-4dd3-bc87-12aafa07cad7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.782232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb7329-564e-4dd3-bc87-12aafa07cad7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.783920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 26/50] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:01.789225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.789513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.789780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.808121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:01.809567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:01.830518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97590d-7643-46a5-b378-3eed9f9c18b2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:01.885835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 27/51] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:01.969504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:01.970118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:01.970411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:01.970689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:01.971383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:01.971692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:01.973087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:01.981419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:01.987839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:02.086570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:02.089659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434990cb-c450-47c0-a18b-3ea5fb39645e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:02.124120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:02.124752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:02.125037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:02.125314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:02.126443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:02.127949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:02.129534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 28/53] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:01 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:02.135088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:02.162253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:02.238728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4edd-8f6f-44df-bb61-659869110679 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:02.241031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:02.262681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2dfb13-2ba0-4723-bdd1-702f09797ec6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:02.278092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:02.278415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:02.278696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:02.279017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:02.282449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:02.282449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:02.284010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:02.289591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:02.300756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:02.301384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:02.301664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:02.301935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:02.303047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:02.304530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:02.306077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:02.311661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:02.347726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:02.392870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f809d74-5ea9-4c0c-a50f-fb8bd5ba98d5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:02.414975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1a0e-d27c-4b31-a365-42d344717178 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:02.427272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:02.427896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:02.428192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:02.428457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:02.429179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.domain.id=default, user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:02.429488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:02.430935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f857f-b9eb-4eca-9986-f05b2eaaa179 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:02.440789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Sep 19 11:00:02 2022] GET /identity/v3/role_assignments?user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b&scope.domain.id=default&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:02.452561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:02.453335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:02.453700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:02.454050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:02.454741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:02.456316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2737e21-48fc-44be-9e04-62bd0857a26c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:02.488370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 30/57] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Sep 19 11:00:02 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:00:04.689057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667853b9-0cb2-4c05-b643-3c04e5047dcd None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:04.689583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667853b9-0cb2-4c05-b643-3c04e5047dcd None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:04.689690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667853b9-0cb2-4c05-b643-3c04e5047dcd None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:04.691300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:04.696651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:04.697063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:04.697216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:04.715969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:04.717240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:04.783978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:05.056270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667853b9-0cb2-4c05-b643-3c04e5047dcd None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:05.093716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:05.159465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667853b9-0cb2-4c05-b643-3c04e5047dcd None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:05.193036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:05.193667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:05.193951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:05.194674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:05.195510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:05.196984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c4b6f-3e8d-4e2a-bccb-8419e8ac0868 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:05.198972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:05.205366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:05.224326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:05.306977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d1639-6c22-44c2-a0cc-9172882ef524 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:05.341497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:05.342603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:05.342887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:05.343184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:05.343836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:05.345300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166520-996a-4003-888a-7269ea3578a0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:05.371757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:05 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:08.734842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb3fe-8141-41ff-b1d8-0a6ab63c8b85 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:08.734842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb3fe-8141-41ff-b1d8-0a6ab63c8b85 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:08.734842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb3fe-8141-41ff-b1d8-0a6ab63c8b85 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:08.735790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:08.740334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2a74-eb03-4e76-959d-fde991cbf24b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:08.741272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2a74-eb03-4e76-959d-fde991cbf24b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:08.741726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac2a74-eb03-4e76-959d-fde991cbf24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:08.765155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c5ac2a74-eb03-4e76-959d-fde991cbf24b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:08.766370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c5ac2a74-eb03-4e76-959d-fde991cbf24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:08.873888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:09.050363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8eb6-5124-4ab5-8e22-3d3804855de6 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.051014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8eb6-5124-4ab5-8e22-3d3804855de6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.051564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8eb6-5124-4ab5-8e22-3d3804855de6 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.053393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 31/64] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:09.063333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc827a-6cc1-4f55-a2e5-c6167dc13217 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.063629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc827a-6cc1-4f55-a2e5-c6167dc13217 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.063916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc827a-6cc1-4f55-a2e5-c6167dc13217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.076252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:09.093414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0efc827a-6cc1-4f55-a2e5-c6167dc13217 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:09.094651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0efc827a-6cc1-4f55-a2e5-c6167dc13217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:09.190133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:09.226233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a082a1-55d2-41ef-adba-056a4b352334 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.226836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a082a1-55d2-41ef-adba-056a4b352334 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.227377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a082a1-55d2-41ef-adba-056a4b352334 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.228944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:09.234303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.234593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.234873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.260731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:09.261955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:09.286883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a082a1-55d2-41ef-adba-056a4b352334 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.414386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:09.471054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a082a1-55d2-41ef-adba-056a4b352334 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:09.481486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:09.514587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.522256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:09.522969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.523277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.523556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.536015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1f7c0926-6d23-44f0-8cfb-bea55e6011ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:09.541152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:09.542021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:09.542800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:09.547868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb3c3-57b4-4816-8b7e-9741512d3827 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.548204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb3c3-57b4-4816-8b7e-9741512d3827 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.548490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfb3c3-57b4-4816-8b7e-9741512d3827 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.550114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 34/69] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:09.553072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfb3c3-57b4-4816-8b7e-9741512d3827 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.590614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:09.632452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7014d0-3458-4901-be6f-ae85fde4d8f5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:09.669957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:09.671035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.671354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.671707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.677657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfb3c3-57b4-4816-8b7e-9741512d3827 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:09.682499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1b7c87f0-b350-411a-b7bd-134b79988475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:09.688403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:09.689304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:09.690079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:09.691507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.692034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.692034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.710632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:09.711979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:09.722185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:09.722802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.723087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.723396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.724056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:09.724359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:09.725778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ded95-74cd-4809-a1f6-9c86b89f9b8e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:09.735241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:09.736548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38ee9-3a12-4025-ada7-e9de5e47cfdf None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.736865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38ee9-3a12-4025-ada7-e9de5e47cfdf None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.737283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d38ee9-3a12-4025-ada7-e9de5e47cfdf None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.738527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 36/72] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:09.739114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38ee9-3a12-4025-ada7-e9de5e47cfdf None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.770279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:09.785036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 37/73] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:09.785902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.848170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:09.855926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d38ee9-3a12-4025-ada7-e9de5e47cfdf None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:09.895400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:09.896469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.897378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.897678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.898360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:09.898714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:09.900158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:09.900847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ca0ce-7485-4d9f-a10b-d4afa125cc0f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:09.914816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 37/74] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:09.914816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:09.947032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:09.947696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.947889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.948164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.960110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4a30fbfa-2778-4ce8-b5b8-327c91ba3807 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:09.965076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:09.965907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:09.966836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:09.968586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:09.968586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:09.968586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:09.986468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:09.987708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:10.019832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.041083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7b496-397a-4f1c-a3b4-25663c7e614a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.072886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 39/76] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:10.073761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.083861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.084851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.085834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.086328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.105693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.107903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.114273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:09 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:10.114273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.128075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.189166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff91c4a-e9c1-48f3-bf23-bc003bcf454a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.217814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535e300-86cc-45b1-a3ce-43f7bfacdecf None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.224251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365033-b87c-43fb-8797-912c11688304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.224900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365033-b87c-43fb-8797-912c11688304 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.225178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365033-b87c-43fb-8797-912c11688304 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.225454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62365033-b87c-43fb-8797-912c11688304 None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.226622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365033-b87c-43fb-8797-912c11688304 None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.228159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62365033-b87c-43fb-8797-912c11688304 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.234643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:10.234643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365033-b87c-43fb-8797-912c11688304 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.260264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.260881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.261162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.261438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.262090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:10.262392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.264399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.277318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:10.277318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.292739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.354710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62365033-b87c-43fb-8797-912c11688304 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.368664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.388841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114708-abc7-4ab7-a2b9-6b5559ded0d7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.391855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.392497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.392777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.393054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.394179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.395776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.397274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:10.398059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.429672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.430294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.430574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.430851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.505687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.505863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e314c0-c3da-4b51-84af-a01b82f6e2b6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.507097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.517843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.540687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.541300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.541580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.541862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.592080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.609837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 40/81] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:10.610711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.613304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.614792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.721201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b88de-0f26-41db-bb05-4788874e240a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.722493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 42/82] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:10.723386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.731088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.757896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.758552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.758719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.759059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.760274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.761730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.763956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 41/83] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:10.764834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.809300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:10.831319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2ea2c-374b-400a-9121-11e159a43361 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.866156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.866796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.867040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9880-010f-4531-a7a7-5c25d5e56060 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:10.867135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.867381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.878422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:10.883410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:10.884281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 43/84] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:10.890057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.905236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:10.906228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:10.906228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:10.906393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:10.907051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:10.908553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:10.936756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 42/85] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:10 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:10.937620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:10.975010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.025541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5675b37-d10f-4976-acfd-11843da5581b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.063670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b8ac8-54b7-40fd-9eb7-f1da26ffb2be None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.069094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb723-0461-4d21-9185-50b42431694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.069805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb723-0461-4d21-9185-50b42431694a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.070067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb723-0461-4d21-9185-50b42431694a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.070347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb723-0461-4d21-9185-50b42431694a None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.071604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb723-0461-4d21-9185-50b42431694a None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.073304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facb723-0461-4d21-9185-50b42431694a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.080255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.080255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb723-0461-4d21-9185-50b42431694a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.089268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.112503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.113139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.113427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.113708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.114890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.116399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.118271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 43/87] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:10 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.119190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.201845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb723-0461-4d21-9185-50b42431694a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.246733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.252161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f4f1b-1c4e-4163-b643-ee16cb859ce1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.252447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.253046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.253330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.253606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.298822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.299101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.299406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.299693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.300361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:11.300668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.302185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.314782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.319631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.342279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.343880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.359547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.446417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025e33d-bc7a-47d1-9e8c-92235c452233 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.455264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 45/89] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:11.456387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.486693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.487731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.488221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.488697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.489624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:11.490309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.492688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.499391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.500577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.534809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.611556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10366d5a-9e2d-47b6-a2b0-dc210de1da19 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.631175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe17ab1-90ba-4c8a-b9b1-438018e0bd5d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.633528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.669650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.670380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.670717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.671008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.671922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:11.672241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.673889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.679734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.680547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/role_assignments?user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.680987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.681406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.681828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.682308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.683817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.686321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.688261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.696478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.867287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b6a3e-399e-4091-84d9-a81e50bab124 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.877228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.901616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4884dd1-8f3c-4f9b-9508-cb2de1685a51 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:11.934495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.935278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.935631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.935922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:11.937667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:11.939183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:11.941149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:11.946997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:11.994219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:11.997487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:11.998982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:11.999461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:11.999748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:12.117988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99a77-0deb-489b-aa79-861f2b37c67e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:12.176290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:12.178157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:12.195181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:12.195181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:12.195181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:12.195181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:12.195575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:12.195575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:12.196583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:12.213627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:12.365696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:12.379587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:12.380548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:12.569389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ef35-d2b7-462e-bbf4-2bf7f421d5bd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:12.576990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:12.637467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:12.639401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:12.640148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:12.640718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] PATH_INFO: `/v3/projects/24707f9573f04fcaa10a2ab49e5772ab` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:12.647657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=24707f9573f04fcaa10a2ab49e5772ab)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:12.649445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea85e-9a62-4458-bb07-4c1c7de87eb7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:12.651498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:12 2022] GET /identity/v3/projects/24707f9573f04fcaa10a2ab49e5772ab => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:12.658557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:12.803634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327b82-1834-491a-a1c3-a0d0f5e9c0e3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:12.855009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:12.855650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:12.855930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:12.856203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:12.856962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=24707f9573f04fcaa10a2ab49e5772ab, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:12.857504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:12.859563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2d84a-67b0-4924-be93-e763d7d4e795 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:12.871681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:12 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=24707f9573f04fcaa10a2ab49e5772ab&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:14.104315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80acf8f-e1b2-4ab6-b58f-732c699788b3 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.105389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80acf8f-e1b2-4ab6-b58f-732c699788b3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.105880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80acf8f-e1b2-4ab6-b58f-732c699788b3 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.107644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:14.113752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5f62-be91-4895-aacc-1ae10f54d93a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.114657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5f62-be91-4895-aacc-1ae10f54d93a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.115195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5f62-be91-4895-aacc-1ae10f54d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.140069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ef8e5f62-be91-4895-aacc-1ae10f54d93a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:14.141635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ef8e5f62-be91-4895-aacc-1ae10f54d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:14.220685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:14.248704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:14.310548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7028b-68e3-4f58-8ccd-018c7437a67a None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.311254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7028b-68e3-4f58-8ccd-018c7437a67a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.311774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7028b-68e3-4f58-8ccd-018c7437a67a None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.313308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:14.319453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c2ace-8fb0-46fe-b0de-e758ec27f078 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.319739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c2ace-8fb0-46fe-b0de-e758ec27f078 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.320003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c2ace-8fb0-46fe-b0de-e758ec27f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.344356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-556c2ace-8fb0-46fe-b0de-e758ec27f078 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:14.345629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-556c2ace-8fb0-46fe-b0de-e758ec27f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:14.436539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:14.664923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69fa5b-8a4b-4e0e-b5e6-2175bbf71915 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.665609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69fa5b-8a4b-4e0e-b5e6-2175bbf71915 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.666089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69fa5b-8a4b-4e0e-b5e6-2175bbf71915 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.667651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 52/102] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:14.673239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.673536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.673820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.689413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69fa5b-8a4b-4e0e-b5e6-2175bbf71915 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:14.706568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:14.708203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:14.862532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:14.905586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69fa5b-8a4b-4e0e-b5e6-2175bbf71915 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:14.910381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:14.957785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:14.958347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:14.958628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:14.958903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:14.984288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:14.989224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:14.990063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:14.990806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:14.992628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:14.997978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.006349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.068532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.087036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d5791-5914-472f-99a9-a99f41388458 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.126520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.127326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.127675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.127964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.129098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:15.130695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:15.132457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:15.143070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.248372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fe26e-0232-4c06-947a-5fa50e4376ad None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.313004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.313928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.314443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.314852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.316050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:15.316490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:15.318433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33608-3ceb-4cc0-902b-ad8dce6f0717 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:15.328163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 54/106] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:15.329850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815947-2553-426a-acc4-3f316e5200bd None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.335263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815947-2553-426a-acc4-3f316e5200bd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.335731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca815947-2553-426a-acc4-3f316e5200bd None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.337348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 55/107] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:15.338101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a198d-dfa2-4f4c-b466-1d2a5a4ff4af None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.338438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815947-2553-426a-acc4-3f316e5200bd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.359738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.386618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.387274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.387558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.387832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.389392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:15.390941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:15.421858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 53/108] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:00:15 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:15.423275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.519687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.534579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca815947-2553-426a-acc4-3f316e5200bd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.612240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.612889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.613168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.613439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.630003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9d8945cb-ee18-46e4-b38a-0a81e3e77b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:15.635042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:15.635926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:15.636910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:15.637513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28e390-1e85-4c05-a5f0-e7a8b2d83d79 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.637589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 56/109] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:15.638233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.638233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.638421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.659771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:15.660995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:15.696310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.697594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.698130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.698668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] PATH_INFO: `/v3/users/89dca3376c6045ec96f2f70127ece703` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.717334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] RBAC: Authorizing `identity:get_user(user_id=89dca3376c6045ec96f2f70127ece703)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:15.719299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:15.721497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:15 2022] GET /identity/v3/users/89dca3376c6045ec96f2f70127ece703 => generated 289 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:15.722606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.754143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:15.755453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:15.758636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.854107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455af85f-430b-4e9a-83d5-5ee150bd158f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.859000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:15.877009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2af9f4-89c5-4274-ac46-5286a853e0a7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:15.900216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.901374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.901800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.902214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.903122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:15.904197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:15.906098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:15.916592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:15.917134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:15.920259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:15.920784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:15.921275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:15.923512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.019023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.021143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad360b1e-0f5f-421a-b8c6-f70f98eb00e8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.079818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.111262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a797d0-0e73-48d0-8db0-70b44f2c28e6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.154726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.155496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.155739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.156020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.157351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.158945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec94a14-3ce2-4282-953a-4dfefe32f8ff None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.161002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:15 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:16.162167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69098-a55e-40e3-9d9d-23553d27dd0f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.162456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69098-a55e-40e3-9d9d-23553d27dd0f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.162736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69098-a55e-40e3-9d9d-23553d27dd0f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.163980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 57/114] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:16.168931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff69098-a55e-40e3-9d9d-23553d27dd0f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.169402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.189380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:16.191217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.191514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.191801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.211852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:16.213291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:16.286617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff69098-a55e-40e3-9d9d-23553d27dd0f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.290911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 59/116] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:16.292004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.349677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.350770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.351296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.351771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.365107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:16.371841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:16.373346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:16.374252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:16.376151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:16.377712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.405372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.425296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbe6cc-0718-4999-a9fb-a711f3d30da8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.441944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.466026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.466780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.467066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.467375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.468535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.470391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9d636-66a6-4536-a295-afd7b1799782 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.472051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:16.473406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06ae2-1455-412d-b457-6bac4080ab67 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.473696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06ae2-1455-412d-b457-6bac4080ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.473969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06ae2-1455-412d-b457-6bac4080ab67 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.479458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 61/119] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:16.479458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06ae2-1455-412d-b457-6bac4080ab67 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.514185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae666b6-d1b2-4370-806c-b842f94b2dab None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.555286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.555931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.556216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.556493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.557737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.559247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.561266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 59/120] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:16.566495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.622776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06ae2-1455-412d-b457-6bac4080ab67 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.665727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.671186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.671786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.672091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.672365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.673021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:16.673323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.674720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5eeff-9dc2-41d5-bc92-ecb63235e79e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.684192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:16.686165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.686407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.686686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.687022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1378ef-8d72-4f1b-bd51-f12a8acce115 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:16.708146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:16.709411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:16.745178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:16.745905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:16.746192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:16.746528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:16.749394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:16.750870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:16.768681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:16.780328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 60/122] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:16 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:16.780328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.814001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 63/123] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:16.815008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:16.992427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c864-0f12-4380-a4d5-58d0a0470f14 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.010450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3374d-b024-42e4-a9bc-4df3d0a962f3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.041561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.042845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.043398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.043960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.045096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=89dca3376c6045ec96f2f70127ece703) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:17.045640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:17.048055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:17.054062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.054711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.054983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.055290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.056368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/role_assignments?user.id=89dca3376c6045ec96f2f70127ece703&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=3a522b729cec4230b34fffa8e659918c => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:17.057658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.072266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:17.075061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:17.080564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:17.081489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:17.082759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 64/125] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:17.088220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.148337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:17.250183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab68b31-30c1-472f-a5e4-073afe73047a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.287004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689792-9635-47c7-8b14-0ac311a752b1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.327182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.328456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.328885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.329331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.330509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:17.330965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:17.332673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:17.347990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:17.349214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.383884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.384781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.385201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.385639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.387034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:17.389887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:17.392834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:17.396574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.531926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:17.551736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfb10-7e64-4e19-80c2-257258a62030 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.593723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.594633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.595030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.595439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.597208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:17.598791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:17.601319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:17.602292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.636579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:17.655303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eec2b-8380-4667-82f1-897ea8989b47 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.723018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68fc47-ef18-4fe1-aeea-9a5bc614d8e7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:17.755945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.756631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.756886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.757182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.779360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:17.780812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:17.781175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:17.781460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:17.785280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:17.786709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:17.789570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:17.792301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 64/129] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:17.793237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:17.798488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:17.799440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:17.800206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 66/130] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:17.802884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:17.827146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:17.996347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159493d-2b5b-473b-9f99-e4d99fa7ddff None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.015335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a43b-39df-4307-a6f7-703c2dd2f72c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.081829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.082874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.083433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.083909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/59c69eba21674f358828f9d75402473e/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.094448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, user_id=59c69eba21674f358828f9d75402473e, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.097548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.110776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.111457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.111744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.112022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.113700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.115218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.119884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 65/131] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:17 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:18.121447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:18.141855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 67/132] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:17 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/59c69eba21674f358828f9d75402473e/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:18.143098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:18.201406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:18.267812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:18.322175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574392d-90ef-454b-830f-8c1189542ee7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.400689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.401338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.401625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.402680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.409748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a58d34-d679-48e7-aa06-e0da40e98387 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.410272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:18.410272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.411495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1346c9-fa42-4352-9ac2-30b46ee2145c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.435978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 66/133] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:18.437417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4d66-e8c7-4a17-805d-3b42fb1a33b4 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.437707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4d66-e8c7-4a17-805d-3b42fb1a33b4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.438109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b4d66-e8c7-4a17-805d-3b42fb1a33b4 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.439418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 67/134] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:18.443187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4d66-e8c7-4a17-805d-3b42fb1a33b4 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:18.462442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.463837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.464080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.464539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/59c69eba21674f358828f9d75402473e/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.468275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, user_id=59c69eba21674f358828f9d75402473e, role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.472170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da976a6-4d09-4edd-8252-d3f38b2873d5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.486669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:18 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/59c69eba21674f358828f9d75402473e/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:18.488745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.489048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.489332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.514401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:18.516097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:18.598937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b4d66-e8c7-4a17-805d-3b42fb1a33b4 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.623480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:18.652753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.653530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.654116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.654428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.655800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.657298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.659719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 68/137] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:18 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:18.668594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:18.678928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:18.827880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84cc45-2271-4d6e-aafe-dfc4de41de5f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:18.875339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:18.876438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:18.876948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:18.877421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] PATH_INFO: `/v3/projects/24707f9573f04fcaa10a2ab49e5772ab` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:18.879469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] RBAC: Authorizing `identity:get_project(project_id=24707f9573f04fcaa10a2ab49e5772ab)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:18.881566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:18.883284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 70/138] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:18 2022] GET /identity/v3/projects/24707f9573f04fcaa10a2ab49e5772ab => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:18.890676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:18.916907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:19.054186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a7abc-ee28-477b-8c71-44edabef37c5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:19.102182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:19.102931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:19.103239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:19.103525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] PATH_INFO: `/v3/projects/24707f9573f04fcaa10a2ab49e5772ab/users/59c69eba21674f358828f9d75402473e/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:19.108478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] RBAC: Authorizing `identity:create_grant(project_id=24707f9573f04fcaa10a2ab49e5772ab, user_id=59c69eba21674f358828f9d75402473e, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:19.109945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:19.126688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:18 2022] PUT /identity/v3/projects/24707f9573f04fcaa10a2ab49e5772ab/users/59c69eba21674f358828f9d75402473e/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:19.240930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:19.364969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:19.399079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41a418-5623-4e8a-826d-6d784ff4e757 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:19.441246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:19.441996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:19.442235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:19.442516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:19.443755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:19.445266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8010b4-f175-44cb-bbff-36d328964a6d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:19.446966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 71/140] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:19.457875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:19.542676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:19.579391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a8978-ebc7-4629-ac47-291079759d77 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:19.617816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:19.618770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:19.619358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:19.619852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:19.620791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:19.623088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01936b-b7d6-431e-8e67-11ecad2d62e4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:19.648197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 70/141] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:19 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:00:20.070863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407b82-fa2e-44e2-8b8f-b3691b9a3f1b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.071277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407b82-fa2e-44e2-8b8f-b3691b9a3f1b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.071454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0407b82-fa2e-44e2-8b8f-b3691b9a3f1b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.072972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 72/142] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:20.078290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.078852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.079357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.104900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:20.105715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23c15-ef4d-429d-b5b1-0fd8d16a4ee2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.106006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23c15-ef4d-429d-b5b1-0fd8d16a4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.106289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23c15-ef4d-429d-b5b1-0fd8d16a4ee2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.107837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:20.108816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 73/143] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:20.141825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.142114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.142390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.176366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:20.177615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:20.198227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 71/144] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:20.265707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 74/145] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:20.554787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:20.622654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:20.671424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c60167-b928-40bb-af80-1eb1569ef952 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:20.716114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:20.716771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.717056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.717329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.731065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:20.736550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:20.737432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:20.738197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 72/146] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:20.744929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:20.832340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:20.866833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913009e3-af4c-42ef-b944-c41889eae70d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:20.912678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:20.913303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:20.913585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:20.913856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:20.914527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:20.914826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:20.916285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:20.931500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 75/147] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:20.933208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:20.938700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.119202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aa49c-8998-40ea-94fe-389c2253fdea None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.150107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:21.188888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c32d0-c463-4119-94c1-0a2fccf81e8c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.191906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.192563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.192846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.193116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.216671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:21.222229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:21.223127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:21.224437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:21.231139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.284431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d27e-544d-451a-97da-369030305703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.284759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d27e-544d-451a-97da-369030305703 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.284858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d27e-544d-451a-97da-369030305703 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.285124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29d27e-544d-451a-97da-369030305703 None admin] PATH_INFO: `/v3/users/89dca3376c6045ec96f2f70127ece703` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.287065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29d27e-544d-451a-97da-369030305703 None admin] RBAC: Authorizing `identity:get_user(user_id=89dca3376c6045ec96f2f70127ece703)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:21.288559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29d27e-544d-451a-97da-369030305703 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:21.290214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:20 2022] GET /identity/v3/users/89dca3376c6045ec96f2f70127ece703 => generated 289 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:21.296156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d27e-544d-451a-97da-369030305703 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.301831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:21.432837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e633e-cdc8-4953-9c0e-65e6b4e34ff2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.518341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.518976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.519661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.519934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.520615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:21.520920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:21.522358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:21.538795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29d27e-544d-451a-97da-369030305703 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.543135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:21.550195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.611233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.611883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.612165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.612442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.613821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:21.615335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:21.618213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:21 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:21.623410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.633761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:21.731249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:21.732916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0207b4-6bb0-44cf-8b4e-34335a531266 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.770684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2261-a55a-4137-a664-e7903242e324 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.771223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.771844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.772160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.772434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] PATH_INFO: `/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.773600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] RBAC: Authorizing `identity:get_user(user_id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:21.775839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a07111-fb0b-4495-b972-eb38c5e518bc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:21.776896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 75/152] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:21 2022] GET /identity/v3/users/a9af0f6bd80b4ed4bd5f3775fe6e3d3b => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:21.777970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85127-a078-4862-8f2d-56aa64279fef None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.778254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85127-a078-4862-8f2d-56aa64279fef None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.779090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba85127-a078-4862-8f2d-56aa64279fef None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.780485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 76/153] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:21.784269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85127-a078-4862-8f2d-56aa64279fef None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:21.815651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.816809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.817392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.817941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/89dca3376c6045ec96f2f70127ece703/roles/3a522b729cec4230b34fffa8e659918c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.820581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, user_id=89dca3376c6045ec96f2f70127ece703, role_id=3a522b729cec4230b34fffa8e659918c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:21.822411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec97f0d-906b-464d-8e41-77889a718358 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:21.839117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:21 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/users/89dca3376c6045ec96f2f70127ece703/roles/3a522b729cec4230b34fffa8e659918c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:21.841569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.842086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.843923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:21.866307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:21.868130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:21.930689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba85127-a078-4862-8f2d-56aa64279fef None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:21.941740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:21.955730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:21.975791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:21.976415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:21.976695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:21.976968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.057908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:22.059329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6ace7-c2be-413e-afed-6a01d6e764c9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:22.168972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 77/156] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:22.174764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:22.189266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8df24-6a06-4611-8793-8111dff6404a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:22.189609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8df24-6a06-4611-8793-8111dff6404a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:22.189831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8df24-6a06-4611-8793-8111dff6404a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.191878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 78/157] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:22.197566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:22.197771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:22.198035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.217811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:22.233094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:22.234548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:22.284630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:22.348785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 79/158] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:22.348948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03222543-e469-4afd-acf2-11efd3d31a88 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:22.394886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:22.395560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:22.395842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:22.396122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.397259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:22.398751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:22.400440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 80/159] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:22 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:22.407217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:22.525457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b69e0-525e-43bc-90f3-a430becabd19 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:22.570769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:22.571418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:22.571698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:22.571971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.572706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:22.573014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:22.574484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:22.581494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 80/160] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:22 2022] GET /identity/v3/role_assignments?user.id=a9af0f6bd80b4ed4bd5f3775fe6e3d3b&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:22.581977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:22.633529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:22.776337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:22.782230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d76fb-e9a5-415e-8ff4-1727cdf082b6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:22.813795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:22.822689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:22.823447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:22.823963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:22.824470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:22.836759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:22.844011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:22.844948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:22.845727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:22.848239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 81/161] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:22.854103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:22.965014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d45ee-2c78-471b-891a-001946796ec9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:22.966108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250476-1624-489c-a803-a9bf0cdac48a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.020687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.021486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.021867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.022247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.023143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:23.023590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:23.025284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:23.039806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.041126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.041608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.042031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.049087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 82/162] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:23.052227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:23.063714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:23.069878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:23.071031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:23.072054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:23.076073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 81/163] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:23.082371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:23.131535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:23.185958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:23.233323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf19f1-a7e8-4070-b5a9-272fe2b86f78 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.246790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df4791-e693-4b70-a3c6-d1b8f4c70a23 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.304275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.304925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.305207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.305482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.306623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:23.308129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e0a4b-e65e-444e-8b0d-0f44ddb69f75 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:23.310130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 83/164] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:23 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:23.311218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161729-dfe5-4847-93b7-462317cf45d9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.311558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161729-dfe5-4847-93b7-462317cf45d9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.311840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161729-dfe5-4847-93b7-462317cf45d9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.313304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 84/165] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:23.313939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.314653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.314935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.315227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.316157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:23.316455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:23.318887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.319436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.319553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:23.319712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.333546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 82/166] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:23.334402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:23.340370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:23.342686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:23.422359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 85/167] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:23.427923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:23.523660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:23.595398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d1ab0-bc04-4e55-ac53-a8a3b595e05c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.625581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4fbae-209f-4d8b-8e1f-e33d994b3479 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.674340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:23.675708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.676831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.677453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.678252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.683849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:23.686227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:23.688200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 86/168] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:23 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:23.694881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:23.702158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:23.702778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:23.703052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:23.703352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:23.847729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:23.849133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:23.917427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db3efa-32eb-4af4-8523-7af3a5a6843f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:23.964955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:24.029701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.030337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.030621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.030893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.069578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 83/169] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:24.070476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.121286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:24.200495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:24.203224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:24.273467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba83dcc-7b36-46b7-b83c-bdd868901a29 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:24.319795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 87/170] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:24.320496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.344975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:24.359887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.360547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.360828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.361100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.394673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:24.405974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:24.406911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:24.407819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 84/171] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:24.412335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.457961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bb40d-5c5d-43b3-95c0-b27c0584b190 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:24.494945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.495620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.495902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.496178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.497414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:24.498927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:24.500864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 88/172] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:24.501448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.579553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:24.592602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b6be-8e3c-4ead-8a8b-9020f318ca58 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:24.605663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:24.634743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5ca36-6df2-43b6-8e5e-9e8a575e4975 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:24.686594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.687740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.688272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.688785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.691366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:24.693186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:24.695229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:24.696347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.703183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.703183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.703183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.703183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.703562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:24.703562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:24.703562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:24.720243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:24.721124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.837901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea68e7-18a1-4ba3-99c6-d920106fc5bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:24.873544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:24.874347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:24.874636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:24.874918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:24.875687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:24.876000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:24.877476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:24.883531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 90/175] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:24.884351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:24.901659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.017580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bfe0b-ad6a-4ce1-8eb3-30be0bdb3818 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:25.034134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39838d3-01d2-4185-bffd-d4669b9426f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:25.082675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:25.083547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.083836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.084115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] PATH_INFO: `/v3/users/59c69eba21674f358828f9d75402473e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.085327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] RBAC: Authorizing `identity:get_user(user_id=59c69eba21674f358828f9d75402473e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:25.086841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7310a1-0e6e-42d7-9766-f17837dbebb7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:25.088829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 91/176] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/users/59c69eba21674f358828f9d75402473e => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:25.090102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f357d14-d7fb-45f8-8ecc-1047eb875581 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.090391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f357d14-d7fb-45f8-8ecc-1047eb875581 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.090668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f357d14-d7fb-45f8-8ecc-1047eb875581 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.092162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 92/177] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:25.093264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976dc1-f059-4824-a5a8-985866aaf085 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.093552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976dc1-f059-4824-a5a8-985866aaf085 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.093890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc976dc1-f059-4824-a5a8-985866aaf085 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.095531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 93/178] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:25.096127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976dc1-f059-4824-a5a8-985866aaf085 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:25.124138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:25.124768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.125045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.125318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.126053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:25.126360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:25.127843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca733be-5823-494e-8eec-bb8931d32527 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:25.145404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 86/179] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:24 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 608 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:25.146552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec049d-8ed6-4eff-bc2f-4bcbb82bb921 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.146835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec049d-8ed6-4eff-bc2f-4bcbb82bb921 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.147101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec049d-8ed6-4eff-bc2f-4bcbb82bb921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.204355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-13ec049d-8ed6-4eff-bc2f-4bcbb82bb921 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:25.205022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.205856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-13ec049d-8ed6-4eff-bc2f-4bcbb82bb921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:25.225489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.241516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc976dc1-f059-4824-a5a8-985866aaf085 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:25.288186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:25.288835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.289119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.289394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.382048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:25.384239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:25.396912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:25.398670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.399263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.399748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.427640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:25.429141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:25.507503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.552408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 94/181] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:25.556940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:25.561510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:25.689326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed6872-00dc-4549-b8c1-e3bfa731e977 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:25.740235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:25.741248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.741746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.742210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] PATH_INFO: `/v3/projects/24707f9573f04fcaa10a2ab49e5772ab` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.744563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] RBAC: Authorizing `identity:get_project(project_id=24707f9573f04fcaa10a2ab49e5772ab)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:25.747457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5725ea-8d99-4cb6-a0a5-444bf4b5bf6c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:25.752434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 95/183] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:25 2022] GET /identity/v3/projects/24707f9573f04fcaa10a2ab49e5772ab => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:25.758471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:25.791826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d0f0-3460-4fef-a855-518086d533f1 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.792444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d0f0-3460-4fef-a855-518086d533f1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.792933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3d0f0-3460-4fef-a855-518086d533f1 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.794983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 96/184] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:00:25.800245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.800798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.801276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.835532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:25.837243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:25.870804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.885108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:25.907189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa43d06-8d7f-47fd-b127-0ec449704cea None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:25.915088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 97/185] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:25.922619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:25.949827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:25.951115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.951745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.951745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.952413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=24707f9573f04fcaa10a2ab49e5772ab, user.id=59c69eba21674f358828f9d75402473e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:25.952726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:25.954242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde874a-af1c-4a13-9157-cdacd0913cc6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 89/186] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:25 2022] GET /identity/v3/role_assignments?user.id=59c69eba21674f358828f9d75402473e&scope.project.id=24707f9573f04fcaa10a2ab49e5772ab&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498122-96a7-4f43-93c2-b3fb0ada8178 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498122-96a7-4f43-93c2-b3fb0ada8178 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498122-96a7-4f43-93c2-b3fb0ada8178 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 90/187] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:25.971476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498122-96a7-4f43-93c2-b3fb0ada8178 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.051374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ee6d-690c-4fce-9c15-4b722831d2e2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.104309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.104941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.105240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.105487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.118397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b7daabb7-be9e-4424-9adc-91baefb87da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:26.123962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:26.124997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:26.125811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 98/188] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:26.126997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.127703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.127703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.135505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498122-96a7-4f43-93c2-b3fb0ada8178 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.150053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:26.151476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:26.190909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.192413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.192632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.192988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.198734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.204291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.210674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:26.216381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:26.217855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 91/189] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:26.218761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.253848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 99/190] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:26.254794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.348027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c756-06ca-4087-94f0-118e46d3e245 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.395020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.395690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.395969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.396241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.396597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741dc067-3390-4bf9-8aea-8e4a459edd4f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.396957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:26.397231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:26.398622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:26.410687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 92/191] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:26.416354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.446113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.446767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.447045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.447352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.448497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:26.449964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:26.451670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 100/192] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:26.456934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.487895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.495045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.540178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b25ae-b065-4598-a57f-d26517f546dc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.572820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070d72c-f5af-4e5b-8822-94c8b49ab9e1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.579395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.580048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.580325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.582028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.582028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:26.582028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:26.583006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:26.592140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 93/193] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:26.592971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.610269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.611337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.611777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.612069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.626186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:26.627762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:26.629512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 101/194] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:26.630315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.703091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f211d3-b909-4d25-a4f8-7b71cfae5f50 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.727269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.727623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:26.737775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92eab3-164b-4eb0-823d-155e21ed9fc7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:26.741280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.741892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.742175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.742452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.743144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:26.744663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:26.766560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 94/195] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:26 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:26.767437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.788556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:26.789226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:26.789708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:26.790665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:26.805828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:26.811333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:26.813253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:26.814168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:26.817964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 102/196] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:26.818974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:26.961546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81c57-aa0a-4bcf-b163-f7833b705e04 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.001715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71920a-62f5-499e-a42f-ed8d9f97c53d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.021659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.022763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.023317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.023798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.028134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.029513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.034947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 95/197] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:27.034947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.050592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.051244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.051528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.052055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.089278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.105066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.175459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.178783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.182770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2f924-cb8d-4627-9791-953f3f3f0532 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.229254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.229767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.230036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.230306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.230964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:27.231322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.234158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.243857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 96/198] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:27.244790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.334933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 103/199] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:27.336115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.374061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce16d9-d5e4-481a-810e-11858d2c9d94 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.388849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.413300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.428180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.429179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.429664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.430241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.474967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dc71c-0553-4e78-b54c-7469455c6abd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.515885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.516453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.516737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.517011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] PATH_INFO: `/v3/users/89dca3376c6045ec96f2f70127ece703` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.518201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] RBAC: Authorizing `identity:get_user(user_id=89dca3376c6045ec96f2f70127ece703)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.519978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.521623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 104/200] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/users/89dca3376c6045ec96f2f70127ece703 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:27.522425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.524060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.526037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.646836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d27d1d-0298-4f89-93d9-c688983e273f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.655471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:27.656961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.668667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.673697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.693430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.694099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.694384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.694663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.696727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.698217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.699990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 105/202] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:27.705906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.802271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda1519-7d47-4688-bea2-0c26ffeb4a9f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.825762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8829c-d35a-476d-8232-a0b53838d8e0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:27.851392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.852771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.853337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.853811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.863430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:27.864166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:27.864520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:27.864867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:27.866151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.867757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.869538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 106/203] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:27.870707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:27.939843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.954951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:27.956785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:27.970581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:27.997851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ee667-80c8-428c-ad45-c16d6491e160 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:28.049089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:28.050659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:28.051191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:28.051645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:28.053351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=61c7f7166079426a820ea06015748582) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:28.053849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:28.056429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:28.065195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 107/204] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/role_assignments?user.id=61c7f7166079426a820ea06015748582&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:28.066655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:28.126077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 98/205] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:28.132534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:28.359696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872a30-052c-46c8-a556-7211d19058e4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:28.447185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:28.466905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef0131-0a0e-4bd3-9d87-4ff557b178a6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:28.493928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:28.495008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:28.495552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:28.496024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:28.496481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:28.497750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=61c7f7166079426a820ea06015748582) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:28.498205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:28.499942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:28.517162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 108/206] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:28 2022] GET /identity/v3/role_assignments?user.id=61c7f7166079426a820ea06015748582&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 259 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:28.546167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:28.547458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:28.548020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:28.548588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:28.550837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:28.553888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d84fe3-dd8c-4437-9989-0bc14d909934 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:28.557156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 99/207] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:28 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:28.568677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:28.779073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbcedc-fd4c-47b4-bccd-c217aae8b21b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:28.878578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:28.879680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:28.880192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:28.880797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:28.882218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, scope.project.id=fcece30dc9b746ffb793c81ffc96c336, user.id=89dca3376c6045ec96f2f70127ece703) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:28.882779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:28.885642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1cd28b-fff4-4180-876b-208b306e77d3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:28.904038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 109/208] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:28 2022] GET /identity/v3/role_assignments?user.id=89dca3376c6045ec96f2f70127ece703&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=3a522b729cec4230b34fffa8e659918c => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:29.583656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656b2e-8edb-4939-a690-c1d8ddc02765 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:29.584155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656b2e-8edb-4939-a690-c1d8ddc02765 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:29.584560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656b2e-8edb-4939-a690-c1d8ddc02765 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:29.587639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 100/209] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:29.594134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5968-527a-4fb9-9d5b-6777dea81dbb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:29.594671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5968-527a-4fb9-9d5b-6777dea81dbb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:29.594671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba5968-527a-4fb9-9d5b-6777dea81dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:29.619952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-98ba5968-527a-4fb9-9d5b-6777dea81dbb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:29.621160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-98ba5968-527a-4fb9-9d5b-6777dea81dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:29.680083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:29.712587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 110/210] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:29.902738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea05c-1b4f-400b-bd59-1e0b640e2b44 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:29.903018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea05c-1b4f-400b-bd59-1e0b640e2b44 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:29.903605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fea05c-1b4f-400b-bd59-1e0b640e2b44 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:29.905248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 101/211] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:29.910894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:29.911537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:29.912016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:29.931783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:29.933312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:30.000865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fea05c-1b4f-400b-bd59-1e0b640e2b44 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.019234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:30.130464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fea05c-1b4f-400b-bd59-1e0b640e2b44 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.167734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.168697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.169794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.170281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.183405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:30.190725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:30.191657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:30.192442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:30.199253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 102/213] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:30.201169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.306293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.324345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59f32d-c95f-47f8-8e42-891d7cd1fdf9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.336001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:30.351015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:30.364298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.366011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.366666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.367565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.368263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:30.368576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:30.370885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:30.383812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 112/214] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:30.390383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.439593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e5724-8c30-40fb-a8f2-1435a58fe650 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.475738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.476378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.476655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.476978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.478107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:30.479667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:30.481956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 103/215] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:30.487106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.514748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c7ea-4399-4e2c-88fb-6554a206e5fa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.570293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.572007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.572442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.572862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] PATH_INFO: `/v3/users/65f3529562724f8d892b575c8571704e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.594361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] RBAC: Authorizing `identity:get_user(user_id=65f3529562724f8d892b575c8571704e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:30.597050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:30.604280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 113/216] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:30 2022] GET /identity/v3/users/65f3529562724f8d892b575c8571704e => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:30.605839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:30.618854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2873-df08-4695-96a8-912c2e0d3319 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.622368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:30.648280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:30.662479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.663102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.663475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.663751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.664573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:30.666029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e743e-1fba-4191-b624-dde3a43d4457 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:30.688100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 104/217] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:30 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:00:30.696386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6662-4f47-499c-b706-f6e02ec9bd3e None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.696669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6662-4f47-499c-b706-f6e02ec9bd3e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.696852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6662-4f47-499c-b706-f6e02ec9bd3e None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.699665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 105/218] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:30.705749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.706029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.706302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.736181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:30.737612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:30.742196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a81ec4-b5f3-4150-b821-891cc0e5bceb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:30.805748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:30.806379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:30.806656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:30.806927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:30.841756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 106/219] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:30.913518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:30.915069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:30.959812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:31.056577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 114/220] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:31.062913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:31.146243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:31.186230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:31.208219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dd6ee-7f17-4ad0-9c32-331ea5504760 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:31.256567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:31.257151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.257431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.257705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.259301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:31.260866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:31.263838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 107/221] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:31.275947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:31.321214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9c49f-7e18-48b5-a15a-aec11c0c3f19 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:31.354200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:31.366445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:31.367467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.367926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.368357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.384916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:31.391759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:31.392906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:31.393884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:31.395946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 115/222] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:31.402158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f0a97-6558-4ede-8f79-6c8e966d1af3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:31.402905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:31.458154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:31.459359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.459950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.461164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.462076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=65f3529562724f8d892b575c8571704e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:31.462720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:31.465356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ddc50-13b5-4a8c-8684-cbde42438ea4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:31.483184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 108/223] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/role_assignments?user.id=65f3529562724f8d892b575c8571704e&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:31.483184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481933c-f3dd-4eaa-80d3-6ed80df0773a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.483184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481933c-f3dd-4eaa-80d3-6ed80df0773a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.483184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481933c-f3dd-4eaa-80d3-6ed80df0773a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.484734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 109/224] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:31.496990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.497476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.497791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.535340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:31.536786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:31.552880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd18b76-5141-43c6-8e89-3e852d94fb8f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:31.564888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:31.623468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:31.625123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.625601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.626136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.627019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:31.627536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:31.629425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:31.646611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 116/225] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:31.648380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:31.678568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 110/226] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:31.718430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:31.789238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce1024-1c91-4740-bfa4-b948f35eff29 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:31.829835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:31.830894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:31.831408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:31.831878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:31.833722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:31.836215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:31.843283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 117/227] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:31.846180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.009529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a794-caae-41c9-8c89-063eedec43b8 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:32.053915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.069684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:32.070612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:32.071026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:32.071491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:32.072891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:32.074594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:32.077603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 111/228] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:31 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:32.084287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.129435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:32.232491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5eb76-c76a-46f5-a93c-88c8c3637f43 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:32.254863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:32.288142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:32.289155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:32.289590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:32.290042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:32.303047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:32.308791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:32.310182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:32.311303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:32.314190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 118/229] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:32.321019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.347564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6a07-e37e-4509-bc33-664117c1b16c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:32.422652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:32.423726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:32.425601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:32.426024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/users/61c7f7166079426a820ea06015748582/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:32.432329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, user_id=61c7f7166079426a820ea06015748582, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:32.434049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:32.456282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 112/230] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:32 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/users/61c7f7166079426a820ea06015748582/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:32.519933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3861352-81e1-4ece-b844-903020e32c68 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:32.577317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:32.577863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:32.578149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:32.578429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:32.579108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:32.583608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:32.585099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:32.601390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 119/231] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:32.610294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.769693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:32.804558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdfc2c-c140-4134-830b-9bc0cfafcba7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:32.858160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:32.858772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:32.859112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:32.859422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:32.861210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:32.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:32.865156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 113/232] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:32 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:32.871088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:32.927905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:33.023981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff88b-9bb9-4953-8e3b-e6e90bfa71d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:33.078037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:33.078762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.079092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.079397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.080708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:33.082395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e866048-ae9f-43bb-a780-c005cb90748e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:33.084638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 120/233] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:32 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:33.090292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:33.226845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396281-676f-4354-b006-ba74c42d8fed None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:33.271400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:33.272204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.272528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.272817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/users/61c7f7166079426a820ea06015748582/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.275409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, user_id=61c7f7166079426a820ea06015748582, role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:33.279425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953af7d4-2166-4de7-9a78-c1050a4b033b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:33.301409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 114/234] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:33 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/users/61c7f7166079426a820ea06015748582/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:33.668422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2280-d6fa-456c-8e0b-12347185b6df None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.668895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2280-d6fa-456c-8e0b-12347185b6df None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.669077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f2280-d6fa-456c-8e0b-12347185b6df None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.671204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 121/235] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:00:33.677755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178f31-f361-4bab-960e-cf05f0391321 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.678107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178f31-f361-4bab-960e-cf05f0391321 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.678487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178f31-f361-4bab-960e-cf05f0391321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.704203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-59178f31-f361-4bab-960e-cf05f0391321 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:33.705547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-59178f31-f361-4bab-960e-cf05f0391321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:33.708112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:33.826499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 115/236] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:33.882326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dde19-70fb-4fc4-8816-3b785b335062 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.882842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dde19-70fb-4fc4-8816-3b785b335062 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.883033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dde19-70fb-4fc4-8816-3b785b335062 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.884491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 122/237] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:33.891098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:33.891411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:33.891694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:33.915383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:33.916601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:34.018034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 116/238] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:34.238873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dde19-70fb-4fc4-8816-3b785b335062 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:34.394788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dde19-70fb-4fc4-8816-3b785b335062 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:34.406295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:34.437310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:34.438110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:34.438580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:34.438945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:34.452433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9d378113-3e2d-4673-8bd6-a8a217bba49e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:34.457543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:34.458493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:34.459347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 123/239] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:34.465110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:34.487824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145bed-3b90-4e7f-92ad-1801b24ab8b6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:34.488447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145bed-3b90-4e7f-92ad-1801b24ab8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:34.488970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b145bed-3b90-4e7f-92ad-1801b24ab8b6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:34.490525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 124/240] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:00:34.497350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:34.498155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:34.498643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:34.523738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:34.525321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:34.568884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:34.623051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947c185-be6e-478c-87ff-44f4e2b80c2e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:34.625754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 125/241] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:34.631194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:34.726856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:34.727881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:34.728369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:34.728844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:34.730002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:34.730542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:34.733022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:34.751382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 117/242] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:34.764329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:34.800816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:34.809090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bd2ad-7c72-4151-9f70-d6db85a1abd9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:34.863494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:34.865085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:34.865592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:34.866144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:34.867787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:34.870184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:34.873662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 126/243] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:34.880474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.009281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439277e-71e4-4300-b43f-e96b9f9b6b22 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.046176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.053870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.054570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.054886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.055370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] PATH_INFO: `/v3/users/5db86273fb2c424abeef9105c653d364` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.072576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] RBAC: Authorizing `identity:get_user(user_id=5db86273fb2c424abeef9105c653d364)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:35.074236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:35.077457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 118/244] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:34 2022] GET /identity/v3/users/5db86273fb2c424abeef9105c653d364 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:35.082982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.119338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bf6e-cc4e-4481-8dae-bf5626dbd954 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.176339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.177607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.178190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.178805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.179855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:35.181724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:35.208323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 127/245] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:34 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:35.209401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.227449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a26aa8-a9b7-4eae-aafa-91f228f5f63d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.273125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.313361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.314040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.314319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.314656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.340237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:35.350058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:35.351125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:35.351951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 119/246] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:35.357971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.422718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87ce49-e8c2-4a02-b3dd-66b7c8496906 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.480610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.481855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.481855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.482029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.493379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.588151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:35.589707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:35.593017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc561b3-90e3-4e12-962e-f514aeb17453 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.626169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.660051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2166b-9426-4221-856c-fb46666739be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.661578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2166b-9426-4221-856c-fb46666739be None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.662019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2166b-9426-4221-856c-fb46666739be None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.662445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2166b-9426-4221-856c-fb46666739be None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.663314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2166b-9426-4221-856c-fb46666739be None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:35.663756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2166b-9426-4221-856c-fb46666739be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:35.666088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2166b-9426-4221-856c-fb46666739be None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:35.678452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 120/247] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:35.680240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059812e2-6177-4e39-b38a-d2b8b162ff96 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.681073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059812e2-6177-4e39-b38a-d2b8b162ff96 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.681500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059812e2-6177-4e39-b38a-d2b8b162ff96 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.687523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 121/248] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:35.695805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.696184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.696549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.726365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:35.727671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:35.752922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 128/249] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:35.754495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.834207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 122/250] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:35.835362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:35.881843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.910091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b076c-6827-4cdd-bcfd-1689a8bcf802 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.951976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8a7ee-ae96-4398-8356-a6f2ceef56bb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:35.954544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:35.975193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:35.980619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:35.981206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:35.981718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] PATH_INFO: `/v3/users/65f3529562724f8d892b575c8571704e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:35.984119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] RBAC: Authorizing `identity:get_user(user_id=65f3529562724f8d892b575c8571704e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:35.986229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:35.989187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 129/251] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/users/65f3529562724f8d892b575c8571704e => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:35.996185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:36.087595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.088370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.088646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.088926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.090705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:36.092622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:36.099715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 123/252] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:36.106416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:36.222114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3324406-9176-4c97-a7d1-a43187f082b9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:36.310421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.311858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.312663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.313405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.315130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:36.317808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcded5a-23e7-4cfe-8e91-aeb59ee2ba8b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:36.320258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 130/253] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:35 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:36.323798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533f01b-9dac-416d-9954-e83d19d7c345 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.326154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533f01b-9dac-416d-9954-e83d19d7c345 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.326639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533f01b-9dac-416d-9954-e83d19d7c345 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.328318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 131/254] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:36.334685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533f01b-9dac-416d-9954-e83d19d7c345 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:36.365425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0082d-b008-4aa6-8742-75d1fa10be2f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:36.379550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:36.413391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.414036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.414317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.414595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.415376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=5db86273fb2c424abeef9105c653d364) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:36.415687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:36.417252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b1c6-f714-4faf-a3c2-782b5a88824f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:36.425055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 124/255] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:36 2022] GET /identity/v3/role_assignments?user.id=5db86273fb2c424abeef9105c653d364&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=3a522b729cec4230b34fffa8e659918c => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:36.426558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:36.427591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.428082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.428195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.452707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:36.453195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:36.535644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 125/256] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:36.536508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:36.548085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533f01b-9dac-416d-9954-e83d19d7c345 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:36.659252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd8d1c-fdf0-4216-b662-843bf36e689d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:36.661148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:36.678781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.681105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.681644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.682142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/users/65f3529562724f8d892b575c8571704e/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.684694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, user_id=65f3529562724f8d892b575c8571704e, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:36.686543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:36.717632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 132/257] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:36 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/users/65f3529562724f8d892b575c8571704e/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:36.729031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.729695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.729973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.730248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.746133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:36.751379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:36.752328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:36.753584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 126/258] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:36.758771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:36.908010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9bcc9-0d5d-4fd9-8b13-8cf7483acd18 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:36.940081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:36.975412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:36.976802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:36.977549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:36.978283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:36.979647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:36.980372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:36.984544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:37.001217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 133/259] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:37.007005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.108577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.197436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e68b4d-f984-49c4-b28f-967468ef85ad None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:37.300316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8cd13-370b-467d-98c8-e178b51fe768 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:37.343919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:37.344574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:37.344851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:37.345124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:37.352017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:37.353614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:37.355541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 127/260] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:37.359947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:37.360842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:37.361269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:37.361689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:37.361975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.383344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:37.394011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:37.395178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:37.396214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:37.399259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 134/261] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:37.407393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.481485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:37.484321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:37.551184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895224f0-154b-418c-b734-ff7a25c67f2a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:37.618808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:37.619464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:37.619748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:37.620022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:37.620701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:37.621003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:37.623240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:37.643887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:37.655490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.663193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fe6df-88c2-4a76-acd3-3dc95c512ce6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:37.704820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:37.705650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:37.705936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:37.706270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:37.819879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:37.821284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:37.853604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86c9a-bbf3-4b1d-a2a8-7772cd715fdc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:37.855707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:37.891268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:37.914987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:37.915684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:37.915966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:37.916242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] PATH_INFO: `/v3/users/61c7f7166079426a820ea06015748582` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:37.919720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] RBAC: Authorizing `identity:get_user(user_id=61c7f7166079426a820ea06015748582)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:37.921253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:37.924282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 136/263] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/users/61c7f7166079426a820ea06015748582 => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:37.932259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:37.997408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 128/264] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:38.008272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:38.116233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1238d0b-d3cd-439d-b9b7-6c142e82e664 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:38.182979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:38.183921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.185058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.185537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.243887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1674f-ff92-4483-b481-6d4da7f47a8e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:38.268019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:38.329251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:38.336310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:38.338491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:38.356793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:38.357656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.357947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.358230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.359666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:38.361199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:38.363148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 129/265] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:38 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:38.376241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:38.529953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 137/266] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:38.536776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:38.630710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:38.654285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb6392-cb73-48d2-b30d-50919f085312 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:38.677077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03c087-0810-4634-bfde-9bd5c04de8e5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:38.718934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:38.720693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.722193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.723285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.726453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:38.728226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfde04-53d6-40f0-abbf-71fe2f752f0a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:38.734547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 138/267] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:38 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:38.737090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50fd9-4395-4230-9dd7-6c19f522be0f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.740247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50fd9-4395-4230-9dd7-6c19f522be0f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.740788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d50fd9-4395-4230-9dd7-6c19f522be0f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.744782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 139/268] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:38.745836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50fd9-4395-4230-9dd7-6c19f522be0f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:38.764995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:38.766023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.766547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.767016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.767985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=61c7f7166079426a820ea06015748582) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:38.768551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:38.770218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a0b87-9801-42b4-af2a-fe6c50884a76 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:38.782649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 130/269] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:38 2022] GET /identity/v3/role_assignments?user.id=61c7f7166079426a820ea06015748582&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:38.786801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311773-ae73-49e4-96d9-d3c370d82fe9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:38.787494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311773-ae73-49e4-96d9-d3c370d82fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:38.788745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311773-ae73-49e4-96d9-d3c370d82fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:38.827492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-52311773-ae73-49e4-96d9-d3c370d82fe9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:38.831568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-52311773-ae73-49e4-96d9-d3c370d82fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:38.949367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:38.962639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 131/270] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:39.005106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d50fd9-4395-4230-9dd7-6c19f522be0f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:39.064876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:39.065850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.066136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.066417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.067182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=61c7f7166079426a820ea06015748582) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:39.067577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:39.069204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659aba6-bd2d-4217-af31-dfa28c9065ee None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:39.080928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 140/271] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:38 2022] GET /identity/v3/role_assignments?user.id=61c7f7166079426a820ea06015748582&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:39.320643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19aa29-9598-496a-8945-0b67b3ea5b2d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.321640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19aa29-9598-496a-8945-0b67b3ea5b2d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.322114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19aa29-9598-496a-8945-0b67b3ea5b2d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.324088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 132/272] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:39.330516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.331133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.331696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.344163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:39.358347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:39.359599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:39.387578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19aa29-9598-496a-8945-0b67b3ea5b2d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:39.472097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 141/273] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:39.536853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19aa29-9598-496a-8945-0b67b3ea5b2d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:39.580231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:39.580849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.581195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.581481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.582621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:39.584169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de362f-a93e-4c7e-9d69-513e2a256677 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:39.586038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 133/274] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:39.592348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:39.648233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba881-6eb1-4c38-bf1b-29059d26ec74 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.648711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba881-6eb1-4c38-bf1b-29059d26ec74 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.649150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dba881-6eb1-4c38-bf1b-29059d26ec74 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.651402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 134/275] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:39.662047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.662525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.662899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.695698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:39.697978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:39.758525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5c18c-2d15-4d36-9c07-77380441814e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:39.776584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:39.791681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 135/276] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:39.800476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:39.803470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:39.807507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:39.808378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:39.809025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:39.809676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:39.810642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:39.812367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:39.842288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 142/277] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:00:39 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:40.012349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8402fb9-6148-415c-b7ca-e053ae58fc15 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.077022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.077773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.078055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.078330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.092178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-365e3f5f-abbc-416f-a3ef-208a45a43e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:40.097482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:40.098418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:40.099288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:40.099947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 136/278] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:40.105185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.161868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444080-2500-4a88-b5ce-a6417f3f8c37 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.162253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444080-2500-4a88-b5ce-a6417f3f8c37 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.163032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af444080-2500-4a88-b5ce-a6417f3f8c37 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.164798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 137/279] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:40.170689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.170953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.171246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.199058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:40.200960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:40.244880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4241334-7d30-48d5-b2ca-9a4a0f48ee24 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.282834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:40.292440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.293072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.293877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.294219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.294894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:40.295236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:40.296659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:40.310275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 143/280] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:40.311230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.321331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 138/281] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:40.323041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.370970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:40.474188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28620f22-d47f-4b28-b690-ee292fe31331 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.506559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75461-db0e-420d-be49-b2e1725632d8 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.556043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.556974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.557403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.557822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.580424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.581342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.581766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.582181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] PATH_INFO: `/v3/users/ef91b1257b93498fbed9b1f365483341` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.596655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:40.602398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:40.603537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:40.604544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:40.610848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 144/282] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:40.620121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.621351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] RBAC: Authorizing `identity:get_user(user_id=ef91b1257b93498fbed9b1f365483341)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:40.625376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:40.628284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 139/283] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/users/ef91b1257b93498fbed9b1f365483341 => generated 293 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:40.634503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.743552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:40.787582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e50d9-c640-4923-8dce-93b6bad4b6c7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.789099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b93461-69a5-4fe5-9384-6f5602882542 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:40.805756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:40.840079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.840883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.841334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.841609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.842278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:40.842576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:40.844013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:40.845870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:40.847303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:40.847809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:40.848308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:40.849244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, user.id=ef91b1257b93498fbed9b1f365483341, scope.system=all) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:40.849756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:40.852200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:40.854702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 145/284] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:40.859903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:40.866318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 140/285] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/role_assignments?user.id=ef91b1257b93498fbed9b1f365483341&scope.system=all&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:40.871247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.034125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5f90d-dd42-41da-846e-06d9fd36ef44 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.036473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:41.082041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.083102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.084421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.084977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] PATH_INFO: `/v3/users/5db86273fb2c424abeef9105c653d364` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.086917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] RBAC: Authorizing `identity:get_user(user_id=5db86273fb2c424abeef9105c653d364)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:41.088801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:41.091886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 141/286] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/users/5db86273fb2c424abeef9105c653d364 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:41.098103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.119262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24be91-38e1-429c-9b64-2e643992df0b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.194191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.195127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.195127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.195446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.213591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:41.220553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:41.221534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:41.222344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:41.222952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 146/287] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:41.231501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.238074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58a8aa-f3d8-4b9f-b5f4-a9a11b502046 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.282049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:41.301969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.302613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.302899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.303182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.305314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:41.311413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:41.313443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 142/288] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:41 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:41.320922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.370483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:41.450379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9034aa-8a16-4050-8fe2-016d62a49d40 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.474067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8ed2d-2605-4bea-a987-7765ccfd44e5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.520990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.521606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.521887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.522163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.522833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:41.523140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:41.524660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:41.530450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.531893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.532641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.533327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/users/5db86273fb2c424abeef9105c653d364/roles/3a522b729cec4230b34fffa8e659918c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.536849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, user_id=5db86273fb2c424abeef9105c653d364, role_id=3a522b729cec4230b34fffa8e659918c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:41.539085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:41.553578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 147/289] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:41.556487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:00:41 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/users/5db86273fb2c424abeef9105c653d364/roles/3a522b729cec4230b34fffa8e659918c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:41.566758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.679830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:41.689396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91fd42-8b74-4638-965d-8f01834042e7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.746879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.747559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.747839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.748114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] PATH_INFO: `/v3/users/65f3529562724f8d892b575c8571704e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:41.749408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] RBAC: Authorizing `identity:get_user(user_id=65f3529562724f8d892b575c8571704e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:41.750982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:41.752825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 148/291] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:41 2022] GET /identity/v3/users/65f3529562724f8d892b575c8571704e => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:41.759671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:41.917257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:41.921715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca173258-3431-4b96-a36d-5d0e77324843 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:41.971215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:41.971849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:41.972256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:41.972535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.053307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:42.054872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:42.170335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:42.170914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:42.176055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:42.362147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea4356-9ba0-41bf-a336-70ce308787e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:42.408099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:42.409122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.409584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.410033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.411471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:42.413226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c24a99-746b-40e0-b2a3-27acd2b6ba94 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:42.415202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 149/293] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:42 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:42.424761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:42.573533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b75db-d033-4d42-916d-4b3a0fcee94b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:42.618533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:42.619266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.619553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.619826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.620539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=65f3529562724f8d892b575c8571704e) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:42.620844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:42.622937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1574be2-6a3e-48f9-9385-9599c721bcc4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:42.629634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 145/294] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:42 2022] GET /identity/v3/role_assignments?user.id=65f3529562724f8d892b575c8571704e&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:42.771521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ee05-6591-4987-9c5f-da499f07ea24 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.771521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ee05-6591-4987-9c5f-da499f07ea24 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.771521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ee05-6591-4987-9c5f-da499f07ea24 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.773364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 150/295] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:42.779548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.780052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.780512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.814898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:42.817003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:42.843198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5ac74-44f5-4e6f-b168-26e87fb54b6b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.843198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5ac74-44f5-4e6f-b168-26e87fb54b6b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.843198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5ac74-44f5-4e6f-b168-26e87fb54b6b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.844741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 151/296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:42.859610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:42.859949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:42.860162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:42.895578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:42.896960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:42.916159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:42.930993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:42.935366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 146/297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:42.990720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 152/298] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:43.268467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.312995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.384968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed727125-a714-4442-96b0-185289a9ad91 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:43.430654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:43.431345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.431619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.431892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.444634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:43.449924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:43.451022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:43.451940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 147/299] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:43.459045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.467288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d409a-5b36-4933-adf9-1a3b45cbddb8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:43.512389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:43.513189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.513571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.513967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.515312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:43.517154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:43.523666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 153/300] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:43.524750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.533734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:43.564118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:43.592229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac0d1c-82f0-4739-b2ab-bc6fbf6edebc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:43.643184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:43.644504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.645183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.645812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.647203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:43.647918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:43.650698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:43.651942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f377f7-e38d-4685-ba79-ebd23cdfd342 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:43.667290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 148/301] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:43.673663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.698564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:43.700298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.701071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.701572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] PATH_INFO: `/v3/groups` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.702426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:43.704664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:43.741798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 154/302] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Sep 19 11:00:43 2022] POST /identity/v3/groups => generated 229 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:00:43.813453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653d9ea-97b6-43eb-a587-ba6c131b0bbb None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:43.834132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:43.859413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:43.860070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.860355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.860630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] PATH_INFO: `/v3/users/a77b9a22eca946d5bd4315d7c93fa040` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.876876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] RBAC: Authorizing `identity:get_user(user_id=a77b9a22eca946d5bd4315d7c93fa040)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:43.878391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22d3b1-4778-4e2b-9c89-c57d4146b70f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:43.880511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 149/303] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:43 2022] GET /identity/v3/users/a77b9a22eca946d5bd4315d7c93fa040 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:43.886442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:43.923767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f5f-6c68-4177-84ec-0c053125a0eb None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.924202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f5f-6c68-4177-84ec-0c053125a0eb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.924306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f5f-6c68-4177-84ec-0c053125a0eb None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.925967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 150/304] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:43.935184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfecdf9-cb83-46f9-85e7-b652937b38be None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:43.935184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfecdf9-cb83-46f9-85e7-b652937b38be None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:43.935184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfecdf9-cb83-46f9-85e7-b652937b38be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:43.957127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-3bfecdf9-cb83-46f9-85e7-b652937b38be None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:43.958456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3bfecdf9-cb83-46f9-85e7-b652937b38be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:44.029754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:44.051898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a1c48-2e51-4c2b-8e6d-035735fcecb0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:44.062376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 151/305] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:44.115068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:44.116547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.117296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.118095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.119796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, user.id=a77b9a22eca946d5bd4315d7c93fa040, scope.system=all) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:44.120665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:44.123738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:44.133810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 155/306] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 19 11:00:43 2022] GET /identity/v3/role_assignments?user.id=a77b9a22eca946d5bd4315d7c93fa040&scope.system=all&role.id=3a522b729cec4230b34fffa8e659918c => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:44.349426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62f10-eaf2-48f7-9aa1-9338c6b76ff3 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.349835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62f10-eaf2-48f7-9aa1-9338c6b76ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.349983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62f10-eaf2-48f7-9aa1-9338c6b76ff3 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.351933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 152/307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:00:44.352218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.357759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.358105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.358352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.378756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:44.380007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:44.464785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 153/308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:44.465433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edecd9-e653-4c3a-bf04-3bd7600601eb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:44.509223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:44.510279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.510770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.511289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.525097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:44.531304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:44.532258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:44.533050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:44.535814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 156/309] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:44.544377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.578674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:44.652686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbe624-daa3-48dd-8086-741623dc8c96 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:44.689667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:44.690812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.691407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.691835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.692512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:44.692812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:44.694206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:44.704113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 154/310] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:44.709786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.726837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:44.750347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.827589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2018438-5391-4638-a3ee-ca5c85568e90 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:44.855652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:44.871181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:44.871181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.871181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.871181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] PATH_INFO: `/v3/users/ef91b1257b93498fbed9b1f365483341` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.871640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] RBAC: Authorizing `identity:get_user(user_id=ef91b1257b93498fbed9b1f365483341)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:44.871709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95282981-cdf6-4591-a140-275b64099dfb None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:44.871778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:44.875149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 157/311] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:44 2022] GET /identity/v3/users/ef91b1257b93498fbed9b1f365483341 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:44.876068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.907922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:44.908485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:44.908766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:44.909043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:44.921857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:44.928801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:44.929763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:44.930574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 155/312] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:44.938384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:44.975877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:45.004878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888da02-3624-420c-8213-f0327f1f6888 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:45.056620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:45.057292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:45.058130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:45.058408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] PATH_INFO: `/v3/system/users/ef91b1257b93498fbed9b1f365483341/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:45.060469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ef91b1257b93498fbed9b1f365483341, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:45.062618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:45.071900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f20f50-a40a-495c-8102-2c158a5c188e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:45.076324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 158/313] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Sep 19 11:00:44 2022] PUT /identity/v3/system/users/ef91b1257b93498fbed9b1f365483341/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:00:45.125304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:45.126009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:45.126355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:45.126631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:45.127374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:45.127724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:45.129434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:45.141396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 156/314] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:45.147711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:45.274408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9196d5c-75dd-402d-9219-7cf83adbb2bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:45.314486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:45.315143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:45.315455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:45.315998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] PATH_INFO: `/v3/users/5db86273fb2c424abeef9105c653d364` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:45.317164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] RBAC: Authorizing `identity:get_user(user_id=5db86273fb2c424abeef9105c653d364)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:45.318673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:45.320601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 159/315] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:45 2022] GET /identity/v3/users/5db86273fb2c424abeef9105c653d364 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:45.327401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:45.352198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:45.501461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100cf72-7850-4dd7-b28a-a1f71ce8eee7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:45.564395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:45.566121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:45.566887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:45.567674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:45.692651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:45.695775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:45.725948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:45.862127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 157/316] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:45.867613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:45.885986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:45.994584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3296b-a07f-4077-aa0d-8811eb07ecbc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:46.033229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:46.033880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.034158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.034433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.035596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:46.037134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51aae82-5011-450a-8e54-02f0d6c33363 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:46.043322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 160/317] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:45 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:46.045346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:46.161500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b378c-3e68-48df-90b0-64961c61d740 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:46.180389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:46.203131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:46.203780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.204063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.204339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.205067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, scope.project.id=772a6017de134b1296cfcdc493043831, user.id=5db86273fb2c424abeef9105c653d364) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:46.205379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:46.206835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6692b-7542-4f21-bd1a-c0d090308348 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:46.214057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 158/318] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:00:46 2022] GET /identity/v3/role_assignments?user.id=5db86273fb2c424abeef9105c653d364&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=3a522b729cec4230b34fffa8e659918c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:46.374992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03917-c0d9-47ba-881a-1e566913c802 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.375306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03917-c0d9-47ba-881a-1e566913c802 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.375590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a03917-c0d9-47ba-881a-1e566913c802 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.377410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 161/319] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:46.388143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273dde-46f9-423f-9a0d-d3749f34e280 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.388662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273dde-46f9-423f-9a0d-d3749f34e280 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.389106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273dde-46f9-423f-9a0d-d3749f34e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.411024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8a273dde-46f9-423f-9a0d-d3749f34e280 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:46.412502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8a273dde-46f9-423f-9a0d-d3749f34e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:46.492851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 159/320] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:46.497626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c336f9-ab02-425a-87f6-a87468bb11c0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.498211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c336f9-ab02-425a-87f6-a87468bb11c0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.498688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c336f9-ab02-425a-87f6-a87468bb11c0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.500556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 162/321] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:46.506416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.506900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.506995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.529323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:46.531192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:46.608934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 160/322] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:46.786528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c336f9-ab02-425a-87f6-a87468bb11c0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:46.880046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:46.896982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:46.923132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c336f9-ab02-425a-87f6-a87468bb11c0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:46.929844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:46.962894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:46.963574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:46.963898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:46.964121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:46.965357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:46.966738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:46.968606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 163/323] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:46.973960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:47.005170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ed7c-f9be-4247-9307-8ae49dba6ebe None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:47.048168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:47.048734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.049047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.049320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.070313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:47.076526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:47.077660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:47.078486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 161/324] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:00:47.083981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:47.102394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77eb40-4b51-4cce-b6e5-919301e20a13 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:47.145092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:47.145946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.146388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.146694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] PATH_INFO: `/v3/groups` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.147308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:47.148775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:47.169858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 164/325] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Sep 19 11:00:46 2022] POST /identity/v3/groups => generated 226 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:00:47.223336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:47.229007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbcb5c-7eaf-46c1-b45d-3e4c9a497b1e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:47.278314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:47.278940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.279240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.279512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.280180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:47.280479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:47.281900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0d00f-e703-467b-ad78-1e92451c7e21 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:47.296777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 162/326] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:47.298233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:47.314734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:47.424935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b8e67-9e26-4b81-9a70-3a9f8f55e74d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:47.456578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc503fb-1eca-4212-b502-ff81153d68ef None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.456914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc503fb-1eca-4212-b502-ff81153d68ef None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.457125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc503fb-1eca-4212-b502-ff81153d68ef None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.458480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 163/327] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:47.464187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:47.464491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.464817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.465164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.465504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] PATH_INFO: `/v3/users/a77b9a22eca946d5bd4315d7c93fa040` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.465837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.466360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.466923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] RBAC: Authorizing `identity:get_user(user_id=a77b9a22eca946d5bd4315d7c93fa040)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:47.468534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:47.470257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 165/328] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:47 2022] GET /identity/v3/users/a77b9a22eca946d5bd4315d7c93fa040 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:47.477495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:47.489796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:47.491004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:47.582764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:47.582941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 164/329] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:47.614531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329600f3-0756-470e-97a4-4417dde79a60 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:47.654168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:47.654859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:47.655139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:47.655454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] PATH_INFO: `/v3/system/users/a77b9a22eca946d5bd4315d7c93fa040/roles/3a522b729cec4230b34fffa8e659918c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:47.657065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a77b9a22eca946d5bd4315d7c93fa040, role_id=3a522b729cec4230b34fffa8e659918c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:47.658533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:47.668218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 166/330] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Sep 19 11:00:47 2022] PUT /identity/v3/system/users/a77b9a22eca946d5bd4315d7c93fa040/roles/3a522b729cec4230b34fffa8e659918c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:00:47.878715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:48.000643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:48.013471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddb041-2bf9-468e-98b2-0aed327d5895 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:48.053600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:48.054598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:48.055081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:48.055601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:48.069040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:48.075460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:48.076406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:48.077257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:48.079973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 165/331] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:48.086584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:48.224148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd68bf-52a4-4d0e-aacd-b5b488ae7a32 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:48.278776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:48.279800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:48.280292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:48.280810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:48.281718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:48.282228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:48.283896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:48.298818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 167/332] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:48.304792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:48.445988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027a66-b0a9-4308-9ad1-8f8edfbf850f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:48.482169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:48.483104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:48.483599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:48.484150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] PATH_INFO: `/v3/users/ef91b1257b93498fbed9b1f365483341` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:48.485548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] RBAC: Authorizing `identity:get_user(user_id=ef91b1257b93498fbed9b1f365483341)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:48.487215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946791d-c97e-4dad-9e93-bc70f821ef95 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:48.489356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 166/333] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:48 2022] GET /identity/v3/users/ef91b1257b93498fbed9b1f365483341 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:48.495731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:48.499291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:48.631941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca59e-23e4-4188-afcf-3bcf3bbbfea9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:48.677275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:48.677893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:48.678173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:48.678476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:48.679196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] RBAC: Adding query filter params (role.id=e5e91b1cac4f4f8fb40ee79ea309e120, user.id=ef91b1257b93498fbed9b1f365483341, scope.system=all) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:48.679515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:48.680987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64897c-1165-4bf3-8602-cd7436645e2a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:48.699874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 168/334] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 19 11:00:48 2022] GET /identity/v3/role_assignments?user.id=ef91b1257b93498fbed9b1f365483341&scope.system=all&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:50.141822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c64c9-949e-4ca2-8e1e-d74f90a928dd None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.142340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c64c9-949e-4ca2-8e1e-d74f90a928dd None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.142340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c64c9-949e-4ca2-8e1e-d74f90a928dd None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.144026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 167/335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:50.150844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724dbd-1b7c-4983-b9cc-74c9c664bfcf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.151473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724dbd-1b7c-4983-b9cc-74c9c664bfcf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.151473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724dbd-1b7c-4983-b9cc-74c9c664bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.179429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-68724dbd-1b7c-4983-b9cc-74c9c664bfcf None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:50.180659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-68724dbd-1b7c-4983-b9cc-74c9c664bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:50.252020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:50.269424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 169/336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:50.638094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563398-a1d9-4b0b-b7ca-55c3c6e7827f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.639179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563398-a1d9-4b0b-b7ca-55c3c6e7827f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.639179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563398-a1d9-4b0b-b7ca-55c3c6e7827f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.640642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 168/337] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:50.645908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.646477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.646952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.672219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:50.673764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:50.717831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dcf7-9c24-4cc5-abcb-93f7bd0f63be None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.718467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dcf7-9c24-4cc5-abcb-93f7bd0f63be None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.718942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44dcf7-9c24-4cc5-abcb-93f7bd0f63be None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.720583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 169/338] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:50.728706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.729342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.729827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:50.759844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:50.762304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:50.792437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 170/339] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:50.792925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:50.828350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:50.876899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 170/340] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:50.947665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cbb85-bae1-4132-9d14-ab249063850b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:50.995558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:50.996796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:50.997466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:50.997767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:50.998319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.013344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:51.018417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:51.019337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:51.020146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 171/341] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:51.028656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.172765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.173301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c773bcd-dc36-425c-9d19-e20faa15ec16 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.214748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.215347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.215630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.215896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.216562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:51.216861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:51.218274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:51.235465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 171/342] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:51.243574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.279071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:51.388716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff604-2900-4207-9be6-72e4f4f6900d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.434677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.435459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.435849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.436133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.442080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178c0be-ad60-426f-9828-4c307568bd2f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.449095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7491c422-dfdb-49e6-a59a-142b928ee0f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:51.455680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:51.456588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:51.457406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 172/343] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:51.458574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d5b-4dbc-4be2-a4db-27afccfe7132 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.459185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d5b-4dbc-4be2-a4db-27afccfe7132 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.459185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d5b-4dbc-4be2-a4db-27afccfe7132 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.466948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 173/344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:51.467945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61d5b-4dbc-4be2-a4db-27afccfe7132 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.484763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.485390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.485735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.486013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.519183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:51.566679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:51.568270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fce98-3fc6-4875-84bb-388fe9d692e8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:51.583810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:51.609259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61d5b-4dbc-4be2-a4db-27afccfe7132 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.662694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.663440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.663719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.663994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.680695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:51.686452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:51.687461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:51.688365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 174/345] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:51.689078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.702028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 172/346] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:51.703805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.704321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.704794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.729459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:51.731753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:51.829393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:51.834506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082afecd-1dd6-458b-828a-6e6840651d2f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.838706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 173/347] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:51.840872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.892071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:51.941345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.942351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.942832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.943347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.944541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:51.945102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:51.956137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:51.956446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27332b32-f94d-468d-a39b-e0bffc95cbf7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:51.983396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 175/348] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:51.984869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:51.994728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:51.997007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:51.997299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:51.997578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:51.998253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:51.998560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.000075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.009564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 174/349] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.010501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.132489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc750b8-ad15-4a8a-9568-fe22a2e105a3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.135516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:52.199141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.201965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.201965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.201965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] PATH_INFO: `/v3/users/a77b9a22eca946d5bd4315d7c93fa040` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.202928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] RBAC: Authorizing `identity:get_user(user_id=a77b9a22eca946d5bd4315d7c93fa040)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.205019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.207389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/users/a77b9a22eca946d5bd4315d7c93fa040 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.208349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.241385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8e2e7-eeda-41ea-8443-ae30fb040b7d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.294293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.295325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.295780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.296202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.297752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.299536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.301657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:51 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.302659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.360154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:52.409567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cb88-b4c8-42af-9ddf-ddcf7f3f5164 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.464896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.466784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.467573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.468004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.477343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fc6bf-9184-4329-be97-e5c9422834f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.528216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.528680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.529066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.529444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.530829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:52.549974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:52.556111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:52.557126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:52.557956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:52.563898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 177/352] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:52.564940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.573274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.576868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.682395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:52.696600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9317b-7551-4f40-9142-2a4e946342f1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.718212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 176/353] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:52.719738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.743146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.743779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.744053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.744327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.745051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] RBAC: Adding query filter params (role.id=3a522b729cec4230b34fffa8e659918c, user.id=a77b9a22eca946d5bd4315d7c93fa040, scope.system=all) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:52.745356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.747802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.761732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 178/354] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/role_assignments?user.id=a77b9a22eca946d5bd4315d7c93fa040&scope.system=all&role.id=3a522b729cec4230b34fffa8e659918c => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.762976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.822182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:52.866890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089a30d-3b61-46d8-99ae-18b0b7c6c588 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.908566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44bfa1-2250-4d05-9dfc-902eaf1c2ac5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:52.916277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.916277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.916580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.916580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.930260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.931816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7bcd9-8a35-4132-bcfe-695a5ef7952a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.936002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 177/355] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.937710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c375-cdba-4476-b5a0-edd525ead76a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.937998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c375-cdba-4476-b5a0-edd525ead76a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.938276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0c375-cdba-4476-b5a0-edd525ead76a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.939575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 178/356] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:52.940355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0c375-cdba-4476-b5a0-edd525ead76a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:52.967567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:52.968198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.968483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.968765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.969435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:52.970216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:52.971983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fa023-d0fc-44e7-a9c4-50a2b700309e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:52.982790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 179/357] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:52.984229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309999-c9c0-4899-898c-940f82393645 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.984523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309999-c9c0-4899-898c-940f82393645 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.984802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca309999-c9c0-4899-898c-940f82393645 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:52.987225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 180/358] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:52.988696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:52.989150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:52.989426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.008638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:53.009843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:53.019425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.072959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0c375-cdba-4476-b5a0-edd525ead76a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.097494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:53.098361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.118561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.119416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.119619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.119891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.121440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:53.122890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b4fb-f8e4-496c-b19a-e46442753b32 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:53.124617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 179/360] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:52 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:53.125767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.126047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.126318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.137315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.148805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:53.150011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:53.234999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 180/361] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:53.243310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.243480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3889572-31ad-4e7f-9190-eb256dea7485 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.291581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.292205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.292531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.292808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.293605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=fcece30dc9b746ffb793c81ffc96c336) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:53.293941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:53.296325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:53.302291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 182/362] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:53.303645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.310145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.399346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be433ece-ec2d-432e-b478-08f49fae2733 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.461281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47898-1b38-4d1d-a2d2-ae70ec483b6c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.467291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.468732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.468732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.468732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.473515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.523610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.524555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.524821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.525198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.529004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:53.530675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:53.533107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 183/363] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:53.533938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.583093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:53.585797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:53.644247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.702201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2468e-b26a-4ff5-89ff-a87edcd00771 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.759679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.760329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.760611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.760886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.762347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 181/364] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:53.764423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.774706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:53.781366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:53.782474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:53.783590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 184/365] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:53.784509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.808881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.901642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787062c2-2505-4f6f-8cba-fdde231a01b3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.912392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873414d-5b2b-4b28-a808-ef1cbe9e48df None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:53.943905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.944870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.945369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.946874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.947889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=fcece30dc9b746ffb793c81ffc96c336) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:53.948409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:53.950802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:53.953848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:53.958734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 182/366] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:53.959783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:53.961412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:53.962073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:53.962362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:53.962702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:53.976508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:53.983039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:53.984061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:53.984853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 185/367] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:53.985501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.093422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.096670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325a51-34e5-4352-8e2e-485517b1d81c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.105791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee1db1-2362-4d12-9557-06071869724a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.144563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.145582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.146091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.146568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.147921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.148192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.148776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.149154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.149524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.150308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:54.150524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.150799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.152924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.159259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 183/368] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:54.160508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.170105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 186/369] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:54.170981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.256787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.313889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ca1ef-4f08-4c34-9472-1108067652e9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.324047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a6d8d-e19e-4892-ba98-7f216a4bdcf9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.358822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.359437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.359700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.359978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.360652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:54.360955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.362556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.368621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.369839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.370321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.370794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.376045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 184/370] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:54.376045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.376954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.379762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.382171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 187/371] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:54.385235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.418735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.522099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c737b8-7c26-451c-8bf2-83cffacb81ec None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.560280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.560903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.561184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.561458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.562517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8230b0-b278-4eb9-a7a0-f61174dc6ff7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.591577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.605323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.606864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.607418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.608029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.650922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.653152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.686961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.699669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.701354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.775086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 185/372] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:54.776478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.831120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 188/373] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:00:54.831120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:54.854757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.899903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3e63e-1395-4c4e-833d-5437ad29690f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.934028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:54.943760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:54.944601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:54.945091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:54.945539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:54.946464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=772a6017de134b1296cfcdc493043831) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:54.946972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:54.948650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:54.950318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf94736-8001-4fc9-b389-1dce54d86885 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:54.957651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 186/374] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:54.958884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:55.024352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.024998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.025334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.031604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.032936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.034408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.037598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 189/375] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:55.041844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:55.079131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa531994-e9b4-4406-bf91-61e0c0bd14a0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:55.162507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.163172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.163519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.163793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] PATH_INFO: `/v3/projects/ba438247ac1f43808755e10d7725b064` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.166211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] RBAC: Authorizing `identity:get_project(project_id=ba438247ac1f43808755e10d7725b064)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.167716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.169931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 187/376] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:54 2022] GET /identity/v3/projects/ba438247ac1f43808755e10d7725b064 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:55.176632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:55.235317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:55.250215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a9110-c98e-4a56-9b4c-37c233301353 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:55.293896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:55.312558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.313801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.314264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.314683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.316947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.318606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.322406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 190/377] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:55 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:55.326874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:55.345326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40538b-f3dd-4f99-b963-d1f330ebb498 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:55.385730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.386371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.387732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.388027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] PATH_INFO: `/v3/groups/9bbd58d07290494aa212b315c7d58cbc` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.398745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] RBAC: Authorizing `identity:get_group(group_id=9bbd58d07290494aa212b315c7d58cbc)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.398745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.398745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 188/378] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:55 2022] GET /identity/v3/groups/9bbd58d07290494aa212b315c7d58cbc => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:55.404023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:55.469973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496fb5f-4875-40a3-97ef-773a8aedd492 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:55.527976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.528798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.529085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.529360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.530098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=772a6017de134b1296cfcdc493043831) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:55.530409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.531989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881f2af-d0d9-489c-bf8c-910dd33d0492 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.551413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 191/379] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:00:55 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:55.582226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483227-2cc2-4669-9283-e2d35a900397 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:55.619031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:55.639380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:55.640022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:55.640303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:55.640578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:55.641313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] RBAC: Adding query filter params (group.id=9bbd58d07290494aa212b315c7d58cbc, role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=ba438247ac1f43808755e10d7725b064) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:55.641618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:55.643103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354101ce-5353-4225-8f3f-21ecb5355010 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:55.650095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 189/380] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:00:55 2022] GET /identity/v3/role_assignments?group.id=9bbd58d07290494aa212b315c7d58cbc&scope.project.id=ba438247ac1f43808755e10d7725b064&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:00:56.097717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64442-07e0-4edb-b30c-9af4741acf05 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:56.098506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64442-07e0-4edb-b30c-9af4741acf05 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:56.098985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e64442-07e0-4edb-b30c-9af4741acf05 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:56.100868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 192/381] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:56.108769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:56.109356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:56.109856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:56.132700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:56.134492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:56.223683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 190/382] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:56.794287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64442-07e0-4edb-b30c-9af4741acf05 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:56.828623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:56.933762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e64442-07e0-4edb-b30c-9af4741acf05 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:56.981428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:56.982079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:56.982355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:56.982626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:56.997607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-19ce849c-d8d2-4bed-8ce5-26da245ba765 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:57.003183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:57.004234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:57.005040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 193/383] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:57.012447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:57.157355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3c7af-d514-4237-a13b-5acc09dcad18 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:57.185111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:57.205419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:57.206305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.206752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.207199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.208051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:57.208492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:57.210262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877a5f7-794e-4c97-ae6d-99fe3fb81c4e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:57.220199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2a0c-86cd-4431-a3d9-0ccb5e962b6d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.220566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2a0c-86cd-4431-a3d9-0ccb5e962b6d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.220909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d2a0c-86cd-4431-a3d9-0ccb5e962b6d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.222454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 194/384] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:00:57.225380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 191/385] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:57.231310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d2a0c-86cd-4431-a3d9-0ccb5e962b6d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:57.239077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.242025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.242482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.280464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:57.281976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:57.408726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:57.430860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 192/386] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:57.452268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d2a0c-86cd-4431-a3d9-0ccb5e962b6d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:57.521410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:57.522083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.522363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.522632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.523843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:57.525340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361b11-2e28-4cd6-898c-a881808e7724 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:57.528254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 195/387] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:57 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:57.533877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:57.743775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7da2-e016-478f-8026-517fdc33cf25 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.744226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7da2-e016-478f-8026-517fdc33cf25 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.744586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf7da2-e016-478f-8026-517fdc33cf25 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.747118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 196/388] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:57.753090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.753456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.753727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.781603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b847eb-1404-4cb3-aed7-d83a9f81d7b6 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:57.800225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:57.801523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:57.805635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:57.865133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:57.866193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:57.866861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:57.867366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:57.869420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:57.871311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:57.873463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 193/389] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:57 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:57.880390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:57.976450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 197/390] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:57.978336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.092423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef32b27-35e5-42b4-b135-d1293ce3c307 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.134473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.135229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.135571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.135846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/groups/4cc154077f0847388c35466bd9192007/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.138370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, group_id=4cc154077f0847388c35466bd9192007, role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:58.139917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edf5bb-2e83-4f97-9f27-ae6c4ba820e4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:58.150670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:58.158027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 194/391] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 19 11:00:57 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/groups/4cc154077f0847388c35466bd9192007/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:58.167221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37734-d1ca-408f-a798-16170f0aaa8e None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.167221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37734-d1ca-408f-a798-16170f0aaa8e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.167221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37734-d1ca-408f-a798-16170f0aaa8e None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.167221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 195/392] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:58.167617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.168028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.168249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.185852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc3690-8a3a-4af1-bcce-441d088761bc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.206360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:58.207767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:58.237395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.238595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.239082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.239650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.245154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:58.272211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:58.290487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:58.291490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:00:58.292280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:58.313213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.339395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 196/394] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:00:58.344416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.520699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a324f-6e74-4b9e-8e97-7e65a593036e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.533560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda86a0-5ba2-4cdd-90ea-980bc065d0d0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.612134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.612705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.613017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.613291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.636530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.638303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.644142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.645027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.646614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:58.647539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:58.651358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:58.653283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:58.675107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:58.676953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:00:58.678566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:58.685670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 197/395] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:58.686216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 199/396] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:58.688012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.692436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.700691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:58.755370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:58.858175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317c044-27cf-4a9c-8547-c96b7cf339b9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.861862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b9bf-988d-41bb-94c1-75dc527ba47d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:58.906122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.907454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.907917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.908363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.924515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:58.925617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.926123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.926608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.928731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:58.929644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:58.931537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:58.939488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 200/397] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:58.939488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c6d802e5-23d3-41ac-909b-2b6d6f407ad1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:58.939764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:58.940831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:00:58.941652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:58.943253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 198/398] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:58.944203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5a2e-2aae-467e-86d6-28ddec7bdba1 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:58.944637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5a2e-2aae-467e-86d6-28ddec7bdba1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:58.945076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e5a2e-2aae-467e-86d6-28ddec7bdba1 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:58.951586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 199/399] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:00:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:00:58.952749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e5a2e-2aae-467e-86d6-28ddec7bdba1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.041132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.083212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.085903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0249ce-2988-40ac-9ba0-e3e7a711d9bb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.098665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e5a2e-2aae-467e-86d6-28ddec7bdba1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.140566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.141257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.141406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.141554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.141852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.142290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.142783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.143296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.143409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.144516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:59.145120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.145357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.147233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 200/400] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.147829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a75d4-91ce-46d1-8ebd-710c35556d5a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.148336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.169033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 201/401] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.171703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.172237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.172579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.196321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:00:59.197611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:00:59.291653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 202/402] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:00:59.292625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b37d2-454f-4555-a076-56c32e804be7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.304549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.342988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.343730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.344080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.344426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.345173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:00:59.345550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.347307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.359362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 201/403] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.361239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.400825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.410798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.482987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d4ade-bc60-4339-9d72-9c261c56b343 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.526387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d2025-8905-44ca-baa8-b981e018f23f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.530322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.531356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.531872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.532372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336/groups/4cc154077f0847388c35466bd9192007/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.534729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] RBAC: Authorizing `identity:create_grant(project_id=fcece30dc9b746ffb793c81ffc96c336, group_id=4cc154077f0847388c35466bd9192007, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.536699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.562819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 203/404] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 19 11:00:59 2022] PUT /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336/groups/4cc154077f0847388c35466bd9192007/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:00:59.562819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.580726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.581458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.581741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.582007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.583389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.585313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.588979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 202/405] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.590722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.724807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478b853-695d-401e-8af6-4fa8a04a609e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.743665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.763497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004baa5-1a10-49b6-86b2-88980773ec1b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.765388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:00:59.781464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.782386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.782660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.782935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.784123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.785653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.787473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.788074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.817243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.817899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.818180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.818461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.838186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:00:59.844868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:00:59.846006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:00:59.846909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:00:59.932029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08cc2e-fc5d-4400-8cd3-09356c22dc56 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:00:59.973208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:00:59.974257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:00:59.974744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:00:59.975334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:00:59.976883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:00:59.978735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:00:59.986368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:00:59.987704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.071923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:00.074633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790956-9567-46fb-89a5-1c40ab06dbf1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.127409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.128206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.128354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.128771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.130138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.132579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.134615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 204/409] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:00.135781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.148009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de906e05-7fb9-42cc-9a8c-aea55b64a2fd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.171696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:00.202785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.203473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.203762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.204205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.205225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:00.205612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.207083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.221086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 206/410] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:00.221950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.261358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4e28-d673-4f3d-a407-9a0c7642edf1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.301728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.302253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.302663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.303073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/groups/4cc154077f0847388c35466bd9192007/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.305312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, group_id=4cc154077f0847388c35466bd9192007, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.307057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.327744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 205/411] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 19 11:01:00 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/groups/4cc154077f0847388c35466bd9192007/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:00.328893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.384224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc138e-dcd4-459a-a3c9-46ff8814f91e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.432719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:00.464449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.465549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.468778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.469452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831/groups/4cc154077f0847388c35466bd9192007/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.474810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] RBAC: Authorizing `identity:create_grant(project_id=772a6017de134b1296cfcdc493043831, group_id=4cc154077f0847388c35466bd9192007, role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.477481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.502690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 207/412] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 19 11:01:00 2022] PUT /identity/v3/projects/772a6017de134b1296cfcdc493043831/groups/4cc154077f0847388c35466bd9192007/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:00.512479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:00.561205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da2872-f564-477f-aef2-4b578fc384a8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.611351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.612677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.613373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.613859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] PATH_INFO: `/v3/groups/9bbd58d07290494aa212b315c7d58cbc` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.615735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] RBAC: Authorizing `identity:get_group(group_id=9bbd58d07290494aa212b315c7d58cbc)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.618021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc9eb08-64c7-455c-aa2d-3ae50832202a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.621264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 206/413] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:00 2022] GET /identity/v3/groups/9bbd58d07290494aa212b315c7d58cbc => generated 229 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:00.627272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.673780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92e06-b5f0-4bf9-bf3a-8a829e950d38 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.674326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92e06-b5f0-4bf9-bf3a-8a829e950d38 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.675028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92e06-b5f0-4bf9-bf3a-8a829e950d38 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.677618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 207/414] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:00.683702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.683984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.684259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.708832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:00.710295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:00.807700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bfa9c-4e8d-4837-bf64-2392ce35aca4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:00.827432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 208/415] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:01:00.852780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:00.853459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:00.853747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:00.854020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] PATH_INFO: `/v3/projects/ba438247ac1f43808755e10d7725b064` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:00.855312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] RBAC: Authorizing `identity:get_project(project_id=ba438247ac1f43808755e10d7725b064)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:00.856863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:00.858965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 208/416] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:00 2022] GET /identity/v3/projects/ba438247ac1f43808755e10d7725b064 => generated 344 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:00.867634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:00.976548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:01.018024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3086-2c79-4107-9ce3-f8bcca61bde6 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:01.065176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:01.066513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:01.066992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:01.067456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] PATH_INFO: `/v3/projects/ba438247ac1f43808755e10d7725b064/groups/9bbd58d07290494aa212b315c7d58cbc/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:01.072607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] RBAC: Authorizing `identity:create_grant(project_id=ba438247ac1f43808755e10d7725b064, group_id=9bbd58d07290494aa212b315c7d58cbc, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:01.074536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:01.098342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 209/417] 10.222.0.20 () {58 vars in 1442 bytes} [Mon Sep 19 11:01:00 2022] PUT /identity/v3/projects/ba438247ac1f43808755e10d7725b064/groups/9bbd58d07290494aa212b315c7d58cbc/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:01.146537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:01.222238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:01.300129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b5c14-a6bf-4c4f-a917-c2db322acf35 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:01.340887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:01.341538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:01.341817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:01.342089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:01.359569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:01.365140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:01.366090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:01.366926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 209/418] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:01.372903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:01.505780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26798d-3239-422c-a8ec-22955e49600d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:01.550616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:01.560176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:01.561469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:01.562175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:01.562735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:01.563854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:01.564235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:01.565906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:01.575969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 210/419] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:01.581336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:01.720918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075e54-8844-4277-84eb-e6b93ec88792 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:01.735807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:01.780952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:01.781494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:01.781776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:01.782049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:01.946327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:01.949762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:02.132783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 210/420] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:02.138926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:02.311072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3052f2d-555c-4867-b89c-ae49f6b4e342 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:02.347695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:02.348354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:02.348635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:02.348906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:02.350044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:02.351746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:02.353963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 211/421] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:02 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:02.360298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:02.378036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:02.517215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16537a58-4987-41da-a921-65ae1e575fdd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:02.577870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:02.578515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:02.578796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:02.579068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:02.583871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:02.585349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829d5e4-06d4-469e-93ac-5a5f6ed2d2c1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:02.587314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 211/422] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:02 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:02.593785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:02.680026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:02.685144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeadd12-a52b-4504-bf8b-159d107afdf2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:02.685443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeadd12-a52b-4504-bf8b-159d107afdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:02.685722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeadd12-a52b-4504-bf8b-159d107afdf2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:02.687397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 212/423] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:02.693097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a4a4-9424-4f52-9f16-3d12787f92f0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:02.693418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a4a4-9424-4f52-9f16-3d12787f92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:02.693686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7a4a4-9424-4f52-9f16-3d12787f92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:02.725715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a1158-3161-4278-8445-ef5ac0436ee0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:02.734099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c1d7a4a4-9424-4f52-9f16-3d12787f92f0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:02.735485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c1d7a4a4-9424-4f52-9f16-3d12787f92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:02.764831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:02.765877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:02.766457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:02.766969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:02.767964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=fcece30dc9b746ffb793c81ffc96c336) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:02.768476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:02.770126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:02.777216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 212/424] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:01:02 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:02.865027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 213/425] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:01:03.215511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:03.269963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785108d-c153-4d71-9a85-0615799d2729 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.270279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785108d-c153-4d71-9a85-0615799d2729 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.270539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785108d-c153-4d71-9a85-0615799d2729 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.272175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 214/426] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:03.278509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81be493-eaa6-4339-a7dd-5bb1f95bbd57 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.278841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81be493-eaa6-4339-a7dd-5bb1f95bbd57 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.279064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81be493-eaa6-4339-a7dd-5bb1f95bbd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.300642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:03.314825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b81be493-eaa6-4339-a7dd-5bb1f95bbd57 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:03.316771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b81be493-eaa6-4339-a7dd-5bb1f95bbd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:03.377579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1735e0-fb53-4d44-906a-02c9caf75a9f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:03.405752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:03.408803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:01:03.410079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bf94d-98b7-416d-8c14-8a4ddc54e603 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.410373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bf94d-98b7-416d-8c14-8a4ddc54e603 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.410648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bf94d-98b7-416d-8c14-8a4ddc54e603 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.411919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 216/428] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:03.417466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.417813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.418090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.428142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:03.430001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.430515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.430984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.440759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:03.442152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:03.444521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:03.450774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:03.452021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:01:03.453026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:03.454166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:03.460196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:03.521982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 217/430] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:03.578144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0ec7-6bc4-4f1c-b34a-9ff134855f61 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:03.613796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:03.615190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.615646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.616091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.616964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] RBAC: Adding query filter params (name=member) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:03.617473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:03.619095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:03.629741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 214/431] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:01:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:03.636687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:03.678857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:03.712356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:03.735371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:03.758695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66937b2-5d50-43b8-8bca-64f7af19915b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:03.797344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f76b6-6fd0-427a-91a0-7de5f6ed7286 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:03.809124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:03.810080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.810578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.811062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.838334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:03.839028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:03.839390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:03.839757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:03.850888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:03.856668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:03.857615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 215/432] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:03.860064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:03.889174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:03.890676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:03.964954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:03.982333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7d442-3cee-4964-9329-e53e9dc9ab8c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:03.992593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.011948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 218/433] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:04.011948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.020730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.021370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.021650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.021920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.033476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:04.038851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:04.040655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 216/434] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:04.041926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.117610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e54dd6-792e-4f29-b730-36fd110530b9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.150178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfea1e5-453e-4aa1-808b-01e051cb4d20 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.153955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.154566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.154898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.155127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.155817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:04.156116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.157527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7587c-8b3d-4404-98a5-4f15f5d2fa25 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.165505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 219/435] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.166836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2244-c8f2-4b13-85ba-1c285ba2bfab None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.167127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2244-c8f2-4b13-85ba-1c285ba2bfab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.167431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce2244-c8f2-4b13-85ba-1c285ba2bfab None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.168934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 220/436] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:04.169638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2244-c8f2-4b13-85ba-1c285ba2bfab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.189038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.189671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.189951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.190222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] PATH_INFO: `/v3/projects/fcece30dc9b746ffb793c81ffc96c336` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.191635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] RBAC: Authorizing `identity:get_project(project_id=fcece30dc9b746ffb793c81ffc96c336)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.193086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.194709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 217/437] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/projects/fcece30dc9b746ffb793c81ffc96c336 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.195500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.198270 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.232068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.273836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce2244-c8f2-4b13-85ba-1c285ba2bfab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.301161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a03da-f3f9-46aa-9d15-2de9e1ba183e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.309696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.310292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.310572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.310852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.311542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] RBAC: Adding query filter params (name=member) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:04.311845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.313229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e8115-d76a-4caf-bddf-90c61aae7181 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.321664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 221/438] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.322839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.323124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.323438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.340234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.340837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.340970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:04.341114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.341387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.342165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:04.411425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 222/439] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:04.412302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.420622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.423136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.439476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.467032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.536249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d0b4d-c1db-4348-8045-a85813c2b920 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.563320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 218/440] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:04.564511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.578548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.579194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.579479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.579743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.580854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.582451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.584208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 223/441] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.584888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.682799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c0b16-7941-4f6f-82e5-4b5c87dfeac0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.685669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.698431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e91845-f217-4afe-b95b-d3a1b1e246b6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.722030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.722645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.722924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.723234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.726666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.733708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.734332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.734609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.734879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.736042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.737537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.739146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 224/442] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.744073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.794687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.796198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.844388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e3147-0d34-4609-bf89-e0d2d62a86f7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:04.877823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:04.878419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:04.878701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:04.878975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:04.879730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=fcece30dc9b746ffb793c81ffc96c336) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:04.880041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:04.881496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:04.887169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 225/443] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=fcece30dc9b746ffb793c81ffc96c336&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:04.887978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.894902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 219/444] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:04.900257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:04.929168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:04.941434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.022288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b7c99-d6ad-4435-b578-fa5a7792fefd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.022726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9fcd0-f412-4b2d-8b31-f78c7046fd5d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.060752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.061393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.061688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.061937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.065191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.066089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.066375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.066649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.067797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.069258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.070840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 220/445] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.071649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.079779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:05.085099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:05.086179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 226/446] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:05.087110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.186216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.191044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780b085-8373-42a7-9d3d-cc48daf49818 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.193538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.210548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6726f6b-e6e4-4bd3-9112-a9c0eaaedddc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.233293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.233936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.234216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.234493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] PATH_INFO: `/v3/projects/772a6017de134b1296cfcdc493043831` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.235780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] RBAC: Authorizing `identity:get_project(project_id=772a6017de134b1296cfcdc493043831)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.237229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.239014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 221/447] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/projects/772a6017de134b1296cfcdc493043831 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.239673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.246911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.247548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.247822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.248087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.248811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=772a6017de134b1296cfcdc493043831) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:05.249114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.250575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.258149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 227/448] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.258988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.385631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba56eaa-f3e4-498d-828b-6218134fae84 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.409338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121b50-97e0-439b-b83a-6b70307e61e0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.441058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.442004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.442410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.442842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.443624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:05.443902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.445272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.458794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 222/449] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.460987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.461620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.461894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.462165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] PATH_INFO: `/v3/groups/4cc154077f0847388c35466bd9192007` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.463870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] RBAC: Authorizing `identity:get_group(group_id=4cc154077f0847388c35466bd9192007)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.465430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.465749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.467052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 228/450] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/groups/4cc154077f0847388c35466bd9192007 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.476412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.498712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.514952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.589768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c3d73-91ee-46f6-bffd-7d5954969fcc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.603738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f0ce6-d471-49ac-a8c2-8a70b4293689 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.626281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.626912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.627222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.627503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.640498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.641009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.641338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.641624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.642391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] RBAC: Adding query filter params (group.id=4cc154077f0847388c35466bd9192007, role.id=e5e91b1cac4f4f8fb40ee79ea309e120, scope.project.id=772a6017de134b1296cfcdc493043831) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:05.642705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.644226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.650777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 229/451] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/role_assignments?group.id=4cc154077f0847388c35466bd9192007&scope.project.id=772a6017de134b1296cfcdc493043831&role.id=e5e91b1cac4f4f8fb40ee79ea309e120 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:05.705786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.707227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.747255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.826731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 223/452] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:05.832582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:05.915320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:05.941820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ffb11-4796-4880-87bb-cf42cc1300e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:05.977132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:05.977680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:05.977955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:05.978222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] PATH_INFO: `/v3/projects/ba438247ac1f43808755e10d7725b064` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:05.979363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] RBAC: Authorizing `identity:get_project(project_id=ba438247ac1f43808755e10d7725b064)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:05.981303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:05.982927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 230/453] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/projects/ba438247ac1f43808755e10d7725b064 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:05.988641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:06.091277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd592ec-eec3-494f-b58c-b65e1b437efe None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:06.126047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:06.126685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:06.126966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:06.127343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] PATH_INFO: `/v3/groups/9bbd58d07290494aa212b315c7d58cbc` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:06.128497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] RBAC: Authorizing `identity:get_group(group_id=9bbd58d07290494aa212b315c7d58cbc)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:06.129961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb5c9-c189-40c1-8055-9d96ad82130a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:06.131592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 224/454] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Sep 19 11:01:05 2022] GET /identity/v3/groups/9bbd58d07290494aa212b315c7d58cbc => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:06.138389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:06.240002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209940a-64c9-42b4-833a-ddbf2bbbc573 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:06.273378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:06.273979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:06.274259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:06.274536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:06.275284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] RBAC: Adding query filter params (group.id=9bbd58d07290494aa212b315c7d58cbc, role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=ba438247ac1f43808755e10d7725b064) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:06.275627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:06.277228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf17c17-eebc-45f7-a60b-9d2647dd3a0b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:06.283688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 231/455] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Sep 19 11:01:06 2022] GET /identity/v3/role_assignments?group.id=9bbd58d07290494aa212b315c7d58cbc&scope.project.id=ba438247ac1f43808755e10d7725b064&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:09.115199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6228-b564-4ac6-a0d6-794390f20bfa None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.115199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6228-b564-4ac6-a0d6-794390f20bfa None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.115199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe6228-b564-4ac6-a0d6-794390f20bfa None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.117373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 225/456] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:09.123467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c505-3fb9-4fc3-b5b7-7d803dd557fd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.124392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c505-3fb9-4fc3-b5b7-7d803dd557fd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.124893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4c505-3fb9-4fc3-b5b7-7d803dd557fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.148246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-adb4c505-3fb9-4fc3-b5b7-7d803dd557fd None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:09.149778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-adb4c505-3fb9-4fc3-b5b7-7d803dd557fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:09.152931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:09.250127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 232/457] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:09.337028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ad6f-5687-42cd-b6f2-2e2b5e05a891 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.337661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ad6f-5687-42cd-b6f2-2e2b5e05a891 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.338136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5ad6f-5687-42cd-b6f2-2e2b5e05a891 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.340569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 226/458] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:09.345947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e411-f4bf-40be-ab4b-90e5b8c81e03 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.346524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e411-f4bf-40be-ab4b-90e5b8c81e03 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.346998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e411-f4bf-40be-ab4b-90e5b8c81e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.373158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9715e411-f4bf-40be-ab4b-90e5b8c81e03 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:09.374703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9715e411-f4bf-40be-ab4b-90e5b8c81e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:09.465504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 233/459] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:09.567288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ad6f-5687-42cd-b6f2-2e2b5e05a891 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:09.570786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:09.684178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f874a3-a6c8-44a2-a49d-e6a6cae2dcae None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.684820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f874a3-a6c8-44a2-a49d-e6a6cae2dcae None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.685318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f874a3-a6c8-44a2-a49d-e6a6cae2dcae None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.687194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 234/460] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:09.693347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.693948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.694414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.716386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:09.717612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:09.720529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5ad6f-5687-42cd-b6f2-2e2b5e05a891 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:09.773649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:09.774292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.774608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.774947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.787125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:09.788642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2136b4fc-494c-45d5-8214-0526025852c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:09.806329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:09.813072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 227/461] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6e6e-c446-440c-8897-34e0e58447eb None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6e6e-c446-440c-8897-34e0e58447eb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6e6e-c446-440c-8897-34e0e58447eb None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 228/462] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:09.814236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6e6e-c446-440c-8897-34e0e58447eb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:09.834196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:09.842169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 235/463] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:09.842816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:09.882005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:09.933160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6e6e-c446-440c-8897-34e0e58447eb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:09.966500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428ea54-0039-48f6-a338-68c8f047cb0f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:09.971747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:09.972384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:09.972712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:09.972991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:09.986281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:09.987793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8472dc1d-9835-4116-9884-9f86854e225f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:10.005119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:10.006068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:10.006914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:10.006914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.006914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:10.006914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 229/464] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:10.007652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.011175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.011175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.014762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.015406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.015958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.016239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.017814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:10.018122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.019663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.029380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:10.031229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:10.033508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 236/465] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:10.034556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.117602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.117933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 230/466] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:10.119851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.159521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.172110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf7a42-5390-42dc-b247-8ba6927052c6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.220060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.220893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.221320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.221770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.222607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:10.223082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.224663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.242511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3523536-c7e2-4525-9658-1c33c323a2d9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.242800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 237/467] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:10.243955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.285960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.286604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.286881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.287186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.287855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.289371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.316983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 231/468] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:10 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:10.317904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.382853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccb532-4753-47b7-a845-c0e7407c7b1c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.427567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.441003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.441666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.441950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.443086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.443983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.457587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39d2e-d4b3-410d-ad73-5d3617bad621 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.459202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.461049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:10.483143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:10.484465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:10.485394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:10.485394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.485394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:10.485394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 238/469] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:10.491318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.514704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.514704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.515079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.519213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.519213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.519213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.546942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 232/470] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:10 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:10.548900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.642387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90c22-ccdc-4b8c-aa46-a47ae29c7c90 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.705476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.706140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.706567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.706843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.722664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.724418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.727665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e3cd0-c581-4e60-9c92-e44bff39a08b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:10.746032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:10.747750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:10.748766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:10.748766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:10.748766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:10.748766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 239/471] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:10.751556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.798008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.820184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.820822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.821099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.821396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.822023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:10.822328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.823819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b23bc-8f0d-4970-b612-1c2ddb76a068 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.846375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 233/472] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:10.852252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb39d8-4097-48a5-8bc4-37c4c565a40e None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.852884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb39d8-4097-48a5-8bc4-37c4c565a40e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.853628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb39d8-4097-48a5-8bc4-37c4c565a40e None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.856396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 234/473] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:01:10.861957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb39d8-4097-48a5-8bc4-37c4c565a40e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:10.874944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:10.911005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337cfe3-108d-49f3-9eb2-0b8962913771 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:10.959127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:10.959762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.960127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.960405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:10.961051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:10.961354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:10.962743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a989e-8253-468b-8a29-3fff478d6a4c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:10.977261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 240/474] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:10.978219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:10.978513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:10.978787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:11.001136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:11.002358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb39d8-4097-48a5-8bc4-37c4c565a40e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:11.002473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:11.044382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:11.045008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:11.045289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:11.045564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:11.046219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:11.048543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:11.079675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 235/475] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:10 2022] POST /identity/v3/users => generated 249 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:11.080590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:11.088031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 241/476] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:11.192509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:11.247717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bce925-8b9e-4318-975e-dc75da8087a6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:11.312071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:11.312698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:11.312977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:11.313252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:11.313908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:11.315391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:11.347062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:11 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:11.452097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:11.468946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:11.570632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475c06-4298-45f7-81e6-753367ee7849 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:11.612140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:11.612762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:11.613049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:11.613324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:11.614005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:11.615494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:11.626779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.sql.core [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:01:11.626779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:01:11.626779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [parameters: {'id': '22edf487be604692b2010aad28180f4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:01:11.626779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:01:11.645236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return ref.to_dict() Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:01:11.646158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application yield resource Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise self.value Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application session.commit() Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:01:11.647538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:01:11.648605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:01:11.649685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:01:11.650564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [parameters: {'id': '22edf487be604692b2010aad28180f4f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:11.655487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 19 11:01:11.657384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:11.659345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 19 11:01:11 2022] POST /identity/v3/roles => generated 144 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:11.659479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:11.770360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e065e-3f09-4d17-93a0-223d554e68b8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:11.794458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:11.817930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:11.818577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:11.818864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:11.819142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:11.836422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-28a4e4fe-8c5c-4b5e-9ee9-64678ef044bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:11.842273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:11.843222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 19 11:01:11.844046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:11.846273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:11.852221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:12.000721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:12.033691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f10c-23fe-4e1d-85f2-82808c36f753 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:12.080775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:12.081398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:12.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:12.081956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:12.082624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:12.082930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:12.084370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111ad57-d4e4-46f1-9fc9-b97158c5c12e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:12.101926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:13.065376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6ea4-0b04-4cb7-bf69-8b2182d5717e None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:13.066690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6ea4-0b04-4cb7-bf69-8b2182d5717e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:13.067213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d6ea4-0b04-4cb7-bf69-8b2182d5717e None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:13.069003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:13.075339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850f04-508a-4ab5-8295-b244f2ae44e8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:13.076184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850f04-508a-4ab5-8295-b244f2ae44e8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:13.076651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850f04-508a-4ab5-8295-b244f2ae44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:13.100177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-35850f04-508a-4ab5-8295-b244f2ae44e8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:13.101687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-35850f04-508a-4ab5-8295-b244f2ae44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:13.227645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:13.271825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469186c6-b2e6-465e-9136-8f2d46e19738 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:13.272135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469186c6-b2e6-465e-9136-8f2d46e19738 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:13.272449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469186c6-b2e6-465e-9136-8f2d46e19738 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:13.273940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 239/483] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:13.297152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:13.297646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:13.298137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:13.340857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:13.342766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:13.451529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:13.460906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 245/484] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:13.674636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469186c6-b2e6-465e-9136-8f2d46e19738 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:13.789796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469186c6-b2e6-465e-9136-8f2d46e19738 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:13.827209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:13.828292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:13.828842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:13.829319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:13.841598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:13.848847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:13.849802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:13.850628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:13.853432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 240/485] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:13.860554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:13.956540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.003757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4be87a-0016-42de-a5a9-fe2ba533e922 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.029679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.064361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.065520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.066656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.067132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.068036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:14.068540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.070152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.081341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 246/486] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:14.087702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.172382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.211294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce0f5f-ffb1-4c0e-bc4a-415ffb106b1b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.229168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea917-daf5-43da-ae56-02ee72a36daf None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.252659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.253470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.253854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.254383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.267339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.268973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:14.285268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:14.286329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:14.287610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:14.287610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:14.287610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:14.287610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 247/487] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:14.294679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.331569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.332704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.333308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.333660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.351617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d7ed400e-940d-49f8-9c08-6021f12629eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:14.359529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:14.361579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:14.363498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:14.371520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 241/488] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:14.371520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569fea-4d71-498a-a0ff-073d30965983 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.371520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569fea-4d71-498a-a0ff-073d30965983 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.371520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569fea-4d71-498a-a0ff-073d30965983 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.373004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 242/489] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:14.374009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569fea-4d71-498a-a0ff-073d30965983 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.431080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796cf05-fef2-458f-89b2-1adde01576fa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.450130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.485548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.486267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.486646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.487020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.487802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:14.488201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.489832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922e25e-85de-4578-8649-72944cb157ff None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.504180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 248/490] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:14.505434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.505745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.506081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.520485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.524914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:14.525810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569fea-4d71-498a-a0ff-073d30965983 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.526115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:14.568931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.569536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.569810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.570091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.570725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:14.571081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.572555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e90ec3-1223-49d1-89d5-0cdf5dd4025a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.582065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 243/491] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:14.583340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21dfc-9524-468a-87d7-1b449f6dcbdb None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.583623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21dfc-9524-468a-87d7-1b449f6dcbdb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.583893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b21dfc-9524-468a-87d7-1b449f6dcbdb None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.587204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 244/492] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:14.587204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21dfc-9524-468a-87d7-1b449f6dcbdb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.619181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 249/493] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:14.619181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.717545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b21dfc-9524-468a-87d7-1b449f6dcbdb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.759312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a8f3f-05e8-4fef-b2db-1b02690fce0d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:14.762393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.764991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.765735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.766109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.766461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.775463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.777876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a3a753b2-1faf-4e7e-ae91-e9a67aff590f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:14.793865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:14.794848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:14.795792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:14.799976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 245/494] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:14.801367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.801656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.801939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.812696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:14.813368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:14.813640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:14.814122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:14.821951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:14.823197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:14.829653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:14.831667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:14.852820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:14.861068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:14.863095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:14.865195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:14.865195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:14.865195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:14.868725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 250/495] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:14.871238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:14.919201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 246/496] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:14.919201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.018509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c043ab-8faf-4361-b3f9-935ff587d1d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.062376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e235e-229c-4ab5-a505-a2234d452ff5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.069030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.069970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.070454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.070934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.072012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:15.072632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.075426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.116924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.117572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.117847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.118120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.118760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:15.119241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.125539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.125872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 251/497] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:15.127474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.136003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 247/498] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:15.137841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.148528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.157005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.268803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882edc-1ce8-4053-b478-08131df58c5b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.281379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a34c0-6d8e-49c3-86ed-748935e0718b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.326969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.327877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.328336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.328620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.330854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.331563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.332982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.333301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.341460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:15.346455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:15.348294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 252/499] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:15.349973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.409688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.411201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.427642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.428883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.461672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8490c-bbb0-4ef6-aa1a-2824b9b3e7ca None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.502996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.503655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.503932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.504204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.512293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.513848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.525684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 248/500] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:15.526462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-403c5aff-9223-4f95-b8ce-ddc3b0cf14b8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:15.528307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:15.529180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 253/501] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27c12-b619-4a36-9b50-dc3cdf6e4188 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.531341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27c12-b619-4a36-9b50-dc3cdf6e4188 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.532359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc27c12-b619-4a36-9b50-dc3cdf6e4188 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.536147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 254/502] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:15.536147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27c12-b619-4a36-9b50-dc3cdf6e4188 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.646768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc27c12-b619-4a36-9b50-dc3cdf6e4188 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.650770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548938-457f-4dec-9617-d580ef9bf9bc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.666067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.682895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.689110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.689835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.689934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.690123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.690396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.690782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.691069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.691356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:15.691462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.691664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.693098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.703907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 255/503] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:15.704200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:15.704776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:15.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:15.710375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 249/504] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:15.711480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.821592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de5dde-aea4-4527-b0ae-13fc233a4ca5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.822832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f955a-84e9-4528-bcc3-ec44dbf55acc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:15.859825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.860048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:15.860441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.860595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.860720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.860878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.860992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.861151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.861715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:15.862020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.863499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.873523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:15.875014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d74e2403-c3d6-41a7-a742-6d1ac7fd157f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:15.890579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:15.891610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:15.892541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:15.892541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:15.892541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:15.892541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 256/505] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:15.892911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623971-b433-4453-ab90-7031706415b3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:15.893194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623971-b433-4453-ab90-7031706415b3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:15.893472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c623971-b433-4453-ab90-7031706415b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:15.906015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 250/506] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:15.906996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:15.913034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8c623971-b433-4453-ab90-7031706415b3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:15.916502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c623971-b433-4453-ab90-7031706415b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:15.942995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.963542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:15.990293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 257/507] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:15.991201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c623971-b433-4453-ab90-7031706415b3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.031302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829b35f-a1a6-43fb-9ac3-b88e3ecc8666 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.073437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.074582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.074865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.075190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.086790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.088349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:16.105250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:16.106253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:16.107142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:16.107142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.107142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:16.107142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 251/508] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:16.108116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.122923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c623971-b433-4453-ab90-7031706415b3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.171054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.172434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.173054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.173432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.174579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:16.175094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.177006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.191537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 258/509] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:16.191537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.225044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.251459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.252781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d0161-3fde-42cb-bb44-63b12ea41552 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.294790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.295526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.295712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.295982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.296622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:16.296929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.298332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.312479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 252/510] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:16.313456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.340192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198a73-c2be-486e-bbac-e41e9f27eda6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.378256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.378866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.379188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.379463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.424481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4c1c1-b330-49ee-adfd-19973260f619 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.455938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.457446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.471546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.472168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.472322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.472650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.473300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:16.473600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.475013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.488560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 253/511] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:16.489436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.492438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.510490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.596804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 259/512] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:16.598538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.611810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc014fef-c3a0-405f-b26d-c818eb8e7b98 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.654881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.655583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.655854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.656137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.674162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.675857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:16.693422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:16.695496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:16.697225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:16.697225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.697225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:16.697225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 254/513] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:16.697225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.761094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33226e99-3ca9-41e3-b8ba-ffed6749deeb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.768889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.798269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.798909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.799211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.799484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.812994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:16.819923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.820999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca333b1-03b2-445c-8473-0e76896208c3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:16.822751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:16.851460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:16.852428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:16.853383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:16.853383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:16.853383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:16.853547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 260/514] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:16.855049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.861486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:16.862209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:16.862568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:16.862893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:16.871701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:16.873392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:16.888983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:16.890033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:16.891120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 255/515] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:16.891848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:16.987704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ba43-ba37-4354-8ef0-5ba6efc47feb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.012384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb545-c80c-471f-bb2c-9c710e689264 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.028654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.030730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.031485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.031775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.032049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.040871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.042967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.054506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.055170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:17.055302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:17.056169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:17.057061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:17.057570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.057570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.057851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 261/516] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:17.057851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.073609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.075126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:17.091046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:17.092222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:17.093199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:17.093199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:17.093199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:17.093199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 256/517] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:17.093199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.122648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.179764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34687-7647-455e-bb68-6fbe6996f292 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.206913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf078595-7e43-43da-b1ce-fc36999688fe None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.220033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.220906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.221274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.221635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.222537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.222929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.224943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.239009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 262/518] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.240173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.247705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da006-9b94-4811-afaf-41074091630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.248306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da006-9b94-4811-afaf-41074091630e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.248588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da006-9b94-4811-afaf-41074091630e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.248863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da006-9b94-4811-afaf-41074091630e None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.249512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95da006-9b94-4811-afaf-41074091630e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.249817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95da006-9b94-4811-afaf-41074091630e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.251264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95da006-9b94-4811-afaf-41074091630e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.264371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 257/519] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.265365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da006-9b94-4811-afaf-41074091630e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.303744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.367571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930219-5d68-4fe4-8082-16d31a35b915 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.380745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.390545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da006-9b94-4811-afaf-41074091630e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.408622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.409241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.409521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.409799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.410490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.410797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.412318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.432495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.433383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.433784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 263/520] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.433970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.434379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.434662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.435555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.436018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.437792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.465980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 258/521] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.466856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.546697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1ee2-6c64-4918-b912-e5beb123d546 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.566291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.585053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261fd5-cfb1-4395-8986-972ce8b7e1b4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.592374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.592986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.593261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.593526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.594160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.594456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.595882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.608745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 264/522] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.609586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.640128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.640778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.641053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.641316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.649611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.650258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.651290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:17.664557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:17.665830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 259/523] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:17.667220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.748496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492bad9-c3a0-4329-8e52-fe3d9569f767 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.775076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346d447-ee1d-47a4-a64c-a46a6eb2603b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:17.785317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.785936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.786265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.786542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.787223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.788713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.813584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 265/524] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:17 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:17.814444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.831740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:17.832378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:17.832664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:17.832940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:17.833701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:17.834017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:17.835583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:17.843560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 260/525] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:17.844460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:17.868577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:17.987520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.023807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0992c4b-7948-4229-a615-1339ee42dcf5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.043612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06cd0-56a8-4d3b-a211-6720521f7861 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.079280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.079906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.080178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.080445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.095029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.095715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.096003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.096272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.105214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.106775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:18.121024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:18.122260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:18.123267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 261/526] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:18.123788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.189364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.192625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.215481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.265843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aebb28-8c08-4f10-9534-c69a8a97d2b7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.314698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.315463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.315463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.316057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.317010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:18.317010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.318735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.331687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.346064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 262/527] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:18.346064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.360723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 266/528] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:18.362713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.478300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc6c2d-dd28-40b8-aa64-42b5a16195f5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.514140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.514799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59c63-85ac-4e6e-8079-54933907e731 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.527900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.528530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.528816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.529095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.529922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:18.530124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.531675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.554333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:18.555499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.589237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.590445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.590913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.591932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.674875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe696-e003-4c26-9ee5-cacb1e9775f0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.681860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.705354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.709146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.713847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.714155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.714503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.714976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.726646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.728224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:18.745540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:18.747248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:18.748762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:18.748762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:18.748762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:18.748762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 264/530] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:18.748762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.797122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:18.871976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216e71-ba5b-4165-aae6-56fc1a90d457 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:18.895868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 267/531] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:18.897337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:18.918347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:18.919492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:18.920734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:18.921270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:18.922186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=12546450f8af46a3816cd8e75e9d3ed2) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:18.923212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:18.925363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:18.941481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 265/532] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/role_assignments?user.id=12546450f8af46a3816cd8e75e9d3ed2&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:18.942769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.024893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:19.043926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd86932-6b06-4590-9c3f-42d4ac3a3822 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.070881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90808cee-8d99-46b2-9a45-e907f08fb70a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.072530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:19.112546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.113175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.113463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.113744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.114399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:19.114702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.116147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.128123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.128779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.129057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.129327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.134243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 268/533] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:19.135651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.158827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.160375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:19.189568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:19.190824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:19.191716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:19.191716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:19.191716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:19.193749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 266/534] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:19.200364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.289174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e93dd9-2b97-4b1f-af25-33afc998b1f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.330725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.331318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.331600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.331876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.339706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.342102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:19.356597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:19.357542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:19.358389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:19.362529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 269/535] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:19.363867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.374164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:19.403335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9712e2-0bce-43b2-92fa-b0530c05c906 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.464558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.465173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.465451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.465721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.466355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:19.466713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.468174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.473259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd5eb-7af6-4c90-926a-154e32202d2e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.494754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 267/536] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:19.502514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.511915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.513381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.513677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.514019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.514721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:19.515032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.516535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.535586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 270/537] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:19.537715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:19.553755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:19.612193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:19.650478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adbab0-01c1-4286-b36d-9a4c8f9d1f48 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.688466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.689095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.689389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.689668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.690401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=478e89a2c7c74b65a7008a49b08ef93a) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:19.690972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.692798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.707786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 271/538] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/role_assignments?user.id=478e89a2c7c74b65a7008a49b08ef93a&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:19.796698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde69b1d-321e-4114-a5d7-79a63d2a1cd4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:19.844225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:19.844909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:19.845260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:19.845540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:19.853458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:19.855770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:19.868651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:19.869541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:19.870483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 268/539] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:19.877306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:20.013826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0664f2a-43d8-47c5-8f8b-01e66cb0467d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:20.047823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:20.051040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:20.051692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.052357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.052637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.053339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:20.054004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:20.055733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab416bbb-3655-47a9-b79a-403101a46df6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:20.069877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 272/540] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:20.075824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:20.194889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:20.231672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ce2c6-4308-465a-8c4f-897076627534 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:20.286694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:20.287341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.287615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.287906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.288654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=7968f762514f42df8264f5cbd1eb37ec) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:20.288958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:20.290388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610ba53-ef59-4995-8f5d-0921cde2a2c0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:20.299694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 269/541] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:20 2022] GET /identity/v3/role_assignments?user.id=7968f762514f42df8264f5cbd1eb37ec&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:20.305605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c9e8-928d-4bde-bb19-93ae7ee586ea None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.306146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c9e8-928d-4bde-bb19-93ae7ee586ea None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.306146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202c9e8-928d-4bde-bb19-93ae7ee586ea None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.308879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 273/542] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:20.313496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a025-67b6-4d3e-8f7e-eaa2f68570d6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.313776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a025-67b6-4d3e-8f7e-eaa2f68570d6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.314047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748a025-67b6-4d3e-8f7e-eaa2f68570d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.341909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7748a025-67b6-4d3e-8f7e-eaa2f68570d6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:20.343279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7748a025-67b6-4d3e-8f7e-eaa2f68570d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:20.439508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 270/543] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:20.465008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c6af-107d-4d11-b3c1-79a7d0cb2a21 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.465304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c6af-107d-4d11-b3c1-79a7d0cb2a21 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.465497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c6af-107d-4d11-b3c1-79a7d0cb2a21 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.467192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 274/544] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:20.473779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.474138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.474323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.500131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:20.501411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:20.598672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:20.605984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 271/545] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:20.755914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c6af-107d-4d11-b3c1-79a7d0cb2a21 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:20.883840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c6af-107d-4d11-b3c1-79a7d0cb2a21 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:20.921794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:20.930107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:20.931094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:20.931615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:20.932116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:20.946620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:20.953221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:20.954202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:20.954997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:20.957923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 275/546] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:20.964214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.049419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615daa3-7468-4000-9912-93219e2dc39c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.086801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.087491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.087774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.088049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.088246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:21.098736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:21.103593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:21.104555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:21.105695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 272/547] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:21.110956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.190879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd54ec-ff56-4641-b82b-95f20ebe47f6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.228777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.229376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.229807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.230086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.230744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:21.231046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.234657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:21.234802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.243030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 276/548] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:21.251190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.322653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a769df-c1c3-4d79-b835-4531a945dba0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.391873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.392499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.392782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.393058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.393720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:21.394224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.395415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.422869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 273/549] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:21.439524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.453946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbc7ea-225b-4cd0-8340-536ca7937718 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.482625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:21.536035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.536666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.536944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.537215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.562015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.565216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.590460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9a154-a1df-43bb-a145-c9f14d24a4da None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:21.594920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:21.596012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:21.596868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:21.596868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:21.596868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:21.605381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 277/550] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:21.610452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.611851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:21.635210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.636401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.636759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.637122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.665361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.666872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:21.701570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:21.702571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:21.704048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:21.704048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:21.704048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:21.704048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 274/551] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:21.711137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.813623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b95bc-382f-4c55-8cbb-4f72f304b68d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.852861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.853883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.854448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.855106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.856132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:21.856652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.857258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0951-a5c3-400d-b65d-79f771c767e2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:21.858499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d00141-db02-4da9-a0a2-456279897601 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.878005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 278/552] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:21.880412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968ccd-fde0-4643-a12d-4173c6850d19 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.881006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968ccd-fde0-4643-a12d-4173c6850d19 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.881672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd968ccd-fde0-4643-a12d-4173c6850d19 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.889393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 279/553] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:21.890705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd968ccd-fde0-4643-a12d-4173c6850d19 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:21.895555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:21.896008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.896308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.896650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.897309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:21.897612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:21.898985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917f3cb-8a9c-4e25-a4a7-70c90398c13d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:21.913255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:21.914700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:21.914987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:21.915284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:21.924580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:21.936752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:21.938061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:21.967006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.020024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd968ccd-fde0-4643-a12d-4173c6850d19 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.027309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 276/555] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:22.028650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.103988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.104599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.104948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.105224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.120741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.122329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.147030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4251-563a-4553-85ba-1df0c5a5f1d1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:22.148672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:22.149563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:22.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 280/556] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:22.155454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.191020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.192098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.192098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.192098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.206129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.207680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:22.236435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:22.237886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:22.238840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:22.242268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 277/557] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:22.249064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.303578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.332373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.342734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c214bd-6d62-475f-9f35-1cb64286b43c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.384878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.385499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.386319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.386589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.387347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:22.387651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.389121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a4bbb-f36d-4c18-9eb4-c73a85509011 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.412717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40e7b1-e9a7-40bf-9ee5-020ce40436ab None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.415128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 281/558] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:22.416570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a203-b640-46be-87ab-ab15a75dc75c None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.416860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a203-b640-46be-87ab-ab15a75dc75c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.417680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a203-b640-46be-87ab-ab15a75dc75c None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.419487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 282/559] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:22.423961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a203-b640-46be-87ab-ab15a75dc75c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.453644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.454175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.454460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.454761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.455519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:22.455832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.457260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.477102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 278/560] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:22.477975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.542959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a203-b640-46be-87ab-ab15a75dc75c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.573969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.580113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.580746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.581047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.581315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.593324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:22.597850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe59b3-455e-4fb4-8bbd-380d5e34c68a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-019c3984-27e9-41a0-8113-f45e3fb3beef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:22.598119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:22.599013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:22.599861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 283/561] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:22.601067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.601067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.601320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.608889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.622304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:22.623528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:22.647372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.648458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.649232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.649697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.662774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.664275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:22.680150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:22.681156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:22.682062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:22.682062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:22.682062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:22.682062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 279/562] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:22.682062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.700792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 284/563] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:22.701651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.808305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a2b82-0684-48df-a9c4-e9e8564c663d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.830542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc3577-d5c6-459b-af41-9cab8fa32b89 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:22.843558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.850510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.851490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.852026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.852645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.853507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:22.854006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.856223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:22.865486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 285/564] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:22.866681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:22.870656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:22.877234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:22.877853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:22.878136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:22.878410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:22.959567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:22.960986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.003458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129d3c-132b-4ee8-924e-f77d63fc535f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.044443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.045048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.045323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.045593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.046216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:23.046515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.047920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.059747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 286/565] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:23.060646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.070580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 280/566] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:23.071442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.102793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.115543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.161597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f32ac-1058-41d9-b71b-43eacef9e6e8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.174326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6f1b-1872-41c2-883f-9ef06674e51f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.195528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.196155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.196436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.196700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.208292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.209497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.209804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.210128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.210408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.210679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.221227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-0eb5e867-d786-4d1b-8441-39a57f668d03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:23.226007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:23.227111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:23.228020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:23.228674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:23.230025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:23.235788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:23.235788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:23.235788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 281/567] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5affc-aff3-4133-92e4-28e96efc60a7 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5affc-aff3-4133-92e4-28e96efc60a7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5affc-aff3-4133-92e4-28e96efc60a7 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 282/568] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:23.236012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5affc-aff3-4133-92e4-28e96efc60a7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.237388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 287/569] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:23.237388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.329892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.338430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73105-adbb-4512-98d3-e88dfd6ff226 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.340243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5affc-aff3-4133-92e4-28e96efc60a7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.346422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.374397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.375024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.375342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.375493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.375629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.376125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.376409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.376680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.382293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.383800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.387517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.388962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:23.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:23.396475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 283/570] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:23.397583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:23.406813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:23.408055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:23.409513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:23.409513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:23.409513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:23.409513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 288/571] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:23.409513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.502574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d77ec-dbc9-4922-8d08-f5145a937480 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.514333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5dee9-aba9-43f1-a469-a6e9457d0c7a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.537262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.537871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.538153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.538428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.539058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:23.539392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.540765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98fc768-28a9-430e-8b8c-b8691c6cf4d6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.548653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.549258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.549536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.549803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.550455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:23.550751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.552470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.552578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 284/572] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:23.553431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.553714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.553988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.565229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 289/573] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:23.566161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.575997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:23.577221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:23.584959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.589195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.647065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 285/574] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:23.647843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.674164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56639-de0b-40b9-994a-18b4473a3c20 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.710607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.711397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.711689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.712282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.712972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:23.713279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.714952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.728204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 290/575] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:23.729037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.759251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bedf5-5b67-430d-b61c-6a4f19913c2c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.796820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.797438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.797720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.797996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.798634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:23.798939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.800350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.818575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 286/576] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:23.818575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.821276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.826723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:23.849035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce02739-545a-4c56-8062-9ffdb8586095 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.885481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.886209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.886402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.886827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.894327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.895826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:23.908681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:23.909829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 291/577] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:23.910958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:23.937605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600757c-b5fb-4a81-97b5-70574351974c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:23.973591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:23.974221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:23.974529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:23.974827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:23.987269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:23.988696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:24.003735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:24.004955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:24.005870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:24.005870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:24.005870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:24.005870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 287/578] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:24.006100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.020102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0d091-010e-49e8-b415-2d4ed7d27e75 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.056410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.057062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.057342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.057684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.069320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.072841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.075184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=a8f507682b7f425ba842a46ad98d9dae, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.076715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.089936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 292/579] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:23 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:24.090760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.131290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417d3ba-c148-40d7-9fd6-04557a5577a6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.175635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.176301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.176638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.176849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.185877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.187403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:24.200914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:24.201911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 288/580] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:24.204348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.220316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb70-3933-407d-ba22-32b3e79988dc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.266590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.267459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.267722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.268032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.268821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:24.269201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.270990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.304815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 293/581] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:24.304815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.335898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7dc17-5c86-4b61-b24b-44b33df54dec None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.350649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.363020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.374041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.375245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.375855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.376340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.391059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:24.398370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:24.399439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 289/582] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:24.400290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.423122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda844f-6c3e-4b1e-a51e-5e0ef93899d1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.467396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.468119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.468401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.468711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.469624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:24.469779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.471441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.486855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 294/583] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:24.487599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.535055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0518-15a8-4438-9c4f-d81aa473840c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.577398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.578802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.578802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.578802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.579248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:24.579553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.580986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.594873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 290/584] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:24.596106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.616584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa5750-d432-4935-b57b-3474f53bfb07 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.627859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.635510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.661307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.662302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.662755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.663329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.676732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.678463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:24.694431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:24.695691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:24.696568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:24.696568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:24.696568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:24.700417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 295/585] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:24.701352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.719287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf423d-176c-4346-ab5e-29741b786bfb None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.758483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.759103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.759450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.759849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.760655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:24.760963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.762345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.772923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 291/586] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:24.778008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.814810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8523f4-88d3-4555-b6d4-5009b2ec1932 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.863037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.863313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.863523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.863770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.872985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.874499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:24.886641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:24.887847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 296/587] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:24.889363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:24.916756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.919281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:24.926249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95ac3d-197e-45f5-a1b8-eb1c10c6e74b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:24.962666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:24.963310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:24.963594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:24.964465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:24.965183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a0a463d7f5db49fe9de8bb390363ba5b) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:24.965489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:24.967071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:24.972434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 292/588] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/role_assignments?user.id=a0a463d7f5db49fe9de8bb390363ba5b&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:24.973327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.043963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191a5d1-eaae-4714-8692-a9c888108922 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.094971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.096430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.096891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.097593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.098420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:25.099046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.101359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.110472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2566f-6a9a-4361-8679-5232c0978a53 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.119694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 297/589] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:25.121552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.172032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.172709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.172989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.173259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.191734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.193219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:25.208654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:25.209681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:25.210574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:25.210574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:25.210574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:25.214806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 293/590] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:25.215720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.237884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.243286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.266741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1848c5-064c-461c-9c3d-82869d0bfe30 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.311909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.312494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.312778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.313054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.313781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:25.314088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.315808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.341439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 298/591] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:25.342301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.362449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0e7b5-6a9b-491e-8595-db3bcf567778 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.411470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.413120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.413608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.414081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.424324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.426148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:25.444443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:25.445379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:25.446267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:25.449601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 294/592] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:25.450898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.463328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a8c95-9a69-49a0-ab96-c98911cf49d3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.507671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.508283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.508571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.508845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.509483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:25.509779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.511220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.518080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.529422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 299/593] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:25.530340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.541433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.584690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154599e-b0ec-4583-9faf-4e3fc25c7697 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.632522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.633074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.633357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.633634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.649130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.650084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915ef8a-4705-411a-bd77-012cab63445d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.650600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:25.670943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:25.671995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:25.672894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:25.672894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:25.672894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:25.675985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 295/594] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:25.677022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.694192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.694805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.695109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.695411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.696101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:25.696405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.698156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.712563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 300/595] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:25.713251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.787415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.806934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03049cec-8db0-4165-92a0-2cca67fb7f56 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.832678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:25.848554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c2d78-7930-45e8-936d-da7930078c33 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:25.850312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.852188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.852693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.853170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.864390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.866932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:25.884587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:25.885621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:25.886796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:25.893367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 296/596] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:25.893367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:25.894187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:25.894876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:25.895186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:25.895465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:25.896179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:25.896478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:25.897908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:25.917790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 301/597] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:25.919461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.035802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d68d-5cf2-43d5-8804-c96a8a1dee59 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.039303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a89d1d-db78-4397-9567-091b105baa4f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.060570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:26.078507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.079554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.079883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.080259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/12546450f8af46a3816cd8e75e9d3ed2/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.085969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.086769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.087234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.087658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.088529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:26.089925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.092151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.098413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=12546450f8af46a3816cd8e75e9d3ed2, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.100134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.114708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 297/598] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:25 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/12546450f8af46a3816cd8e75e9d3ed2/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:26.119537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 302/599] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:26.120578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.121587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.200656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:26.245167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eae97-29cd-452e-83a2-1d648f3cda7a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.293080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.294058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.294493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.295303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.311388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.314150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:26.333786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:26.334885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:26.335799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:26.335799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:26.335799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:26.338312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 303/600] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:26.345962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.383129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:26.392448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc1b2-3e95-478e-b4b7-ae63392011d2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.444555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.445354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.445638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.445961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.459702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.460243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2644a377-296b-49e5-b3fa-bffc90aaa267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:26.475879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:26.476819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:26.477714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:26.478136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1245b-3093-48cc-ac26-74bed9b13b2a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.478219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 298/601] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:26.478756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3426d-3048-4004-bfb7-3a197914a0f7 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.478866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3426d-3048-4004-bfb7-3a197914a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.479137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3426d-3048-4004-bfb7-3a197914a0f7 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.486161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 299/602] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:26.486958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3426d-3048-4004-bfb7-3a197914a0f7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.531585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.532209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.532499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.532775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.533424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:26.533727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.535120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c1a83-cfb8-4bec-8288-9ce45318ceed None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.552192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 304/603] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:26.557842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.557842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.557842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.580438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:26.581689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:26.610538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:26.622807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3426d-3048-4004-bfb7-3a197914a0f7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.661379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.662337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.662814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.663320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.664219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:26.664732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.666355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.679710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 305/604] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:26.680714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.687415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 300/605] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:26.690067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.702104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:26.804347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ec567-e876-4342-acaf-3aa154da9d85 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.846539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:26.847211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:26.847493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:26.847770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:26.861041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:26.862546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:26.878464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:26.879448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:26.880321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 306/606] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:26.887052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:26.945035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326592ff-849d-4c92-bd6e-42ac6eed18a4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:26.984519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:27.010447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa061b0-e766-471d-adf7-b2623ed49c49 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:27.049576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.050186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.050467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.050740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.051500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:27.051805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:27.053252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:27.067090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 307/607] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:27.071878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.072565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.072853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.073160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/478e89a2c7c74b65a7008a49b08ef93a/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.073521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:27.113398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=478e89a2c7c74b65a7008a49b08ef93a, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:27.115217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:27.139094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 301/608] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:26 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/478e89a2c7c74b65a7008a49b08ef93a/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:27.139094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:27.160898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:27.251013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d24fad-ca71-43d8-a1cc-f91e716a7db3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:27.322524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.323145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.323463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.324107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/7968f762514f42df8264f5cbd1eb37ec/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.336675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:27.342488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=7968f762514f42df8264f5cbd1eb37ec, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:27.344085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91448920-252e-44cb-9ed4-b9079bef84e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:27.351383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d5e26-793c-4268-8521-24cc13a77770 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:27.360751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 308/609] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:27 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/7968f762514f42df8264f5cbd1eb37ec/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:01:27.362118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481cebb-beca-4a3b-8920-86e2e47e51e8 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.362413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481cebb-beca-4a3b-8920-86e2e47e51e8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.362694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481cebb-beca-4a3b-8920-86e2e47e51e8 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.368509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 309/610] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:27.374750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.375053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.375408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.400099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.401924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.402097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:27.402815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.404195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:27.404591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.418731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:27.424145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:27.425095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:27.425957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:27.428754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 302/611] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:27.435765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:27.501900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 310/612] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:01:27.522884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:27.583349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828ecc1-56c9-45a5-b612-f8d8f35984fd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:27.625633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.626972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.627493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.627917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.628734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:27.629188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:27.630801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:27.642404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 303/613] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:27.648407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:27.770703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02700321-d1ac-475c-a69b-fd0cf37f6575 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:27.797882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:27.820630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:27.821584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:27.822042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:27.822466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:27.827939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:27.843009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:27.844451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:27.865722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:27.866723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:27.867682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:27.867682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:27.867682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:27.873254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 311/614] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:27.878047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.001053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4147da-f347-414f-b62c-4442edfb6e4d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.054783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.068497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae3738-7b94-4bf0-82b0-0c4f3e33d854 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.072526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.073286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.074759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.075143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.091963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:28.097577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:28.098510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:28.099371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 304/615] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:28.105922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.131215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.131845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.132129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.132403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.133056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:28.133361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.134781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.158394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 312/616] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:28.168372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.250981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f8fee-a669-4a32-bc86-4c27bd1d6be6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.251497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.298150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.298819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.299188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.299469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.300129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:28.300432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.301808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.311887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 305/617] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:28.317738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.361265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103326b1-b50f-4501-b605-8c1b24f0756c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.397546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.398188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.398462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.398729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.407082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.408672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.414392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:28.424736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:28.425718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:28.426733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 313/618] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:28.431521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.530225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c301c-8c31-4508-bd06-4abb7f0c72f5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.547534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.552584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13644b4c-d947-481e-bbc9-35080dc4493e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.607988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.608645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.608920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.609193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.629987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.630532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.630809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.631078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.631864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:28.632166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.633704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.637737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.641211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:28.674522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:28.675624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:28.676529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:28.676529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:28.676529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:28.676704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 314/619] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:28.676777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 306/620] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:28.680035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.683664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.811987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a319769-a105-433b-9e01-d2094fdd0c97 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.843566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.848441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa1e3-1cb1-4643-8a70-c2dc38e117b1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:28.856121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.856794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.857075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.857345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.876377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:28.888301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:28.889301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.889726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.890138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.890912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:28.891377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.892914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5fb35-8ecc-4456-917c-846db4c0e90f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:28.907572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 307/621] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:28.909207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c27-d580-48b0-abca-c2ff5e9e2b02 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:28.909665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c27-d580-48b0-abca-c2ff5e9e2b02 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:28.910078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c27-d580-48b0-abca-c2ff5e9e2b02 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:28.912531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 308/622] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:28.913557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d4c27-d580-48b0-abca-c2ff5e9e2b02 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:28.944882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:28.946842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14425a56-abca-47a7-bda8-3fca05e55854 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.038355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d4c27-d580-48b0-abca-c2ff5e9e2b02 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.074828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 315/623] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:29.076789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.077221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.077777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.086902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.087621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.087967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.088245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.096304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.097768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.101388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:29.102756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:29.112739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:29.113900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:29.115189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:29.118840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 309/624] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:29.119715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.147321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.168321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.200697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 316/625] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:29.202117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.289956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16679ae3-3a5f-4d61-86dc-b86020220655 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.319008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089825-2be8-45cd-a63d-65d70740ef8f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.360654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.361694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.362200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.362649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.363605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:29.364156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.365843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.368379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.369751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.369751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.369751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.388436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 317/626] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:29.393738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.399490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.401780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:29.437469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:29.438472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:29.439386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:29.439386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:29.439386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:29.447304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 310/627] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:29.449866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.453591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.512909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4769f-635d-4005-bd2a-389c45cac05c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.552023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.552954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.553436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.554075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.566922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.568967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:29.587521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:29.589139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:29.590025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:29.590025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:29.590025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:29.592673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 318/628] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:29.593798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.627004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.663902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cb0c2-64b1-47d8-b6f4-b6cd65752c23 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.703783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.704550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.704926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.705333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.706132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:29.706528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.708120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.719562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.724498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 311/629] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:29.725442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.734803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335662c8-51cc-4477-9cea-4da62b93dd7a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.772289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.772933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.773216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.773485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.784638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-dd1bf962-82ee-4a46-ab0b-a07648db5e03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:29.790083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:29.791633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:29.792513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 319/630] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:29.793290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7ad8-61d5-4d24-b2df-3e6635207cd7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.793366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7ad8-61d5-4d24-b2df-3e6635207cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.793647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe7ad8-61d5-4d24-b2df-3e6635207cd7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.795108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 320/631] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:29.795612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7ad8-61d5-4d24-b2df-3e6635207cd7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.850671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c29-6517-4a40-adcc-eeb058244a64 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.882866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:29.888596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.889217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.889493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.889764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.890396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:29.890694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.892112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.910457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 312/632] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:29.910457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:29.912002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe7ad8-61d5-4d24-b2df-3e6635207cd7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:29.953648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:29.954869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.954869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.954869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.961784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:29.963312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8c9dceb2-5f3a-420c-905c-f0c8d42db70a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:29.974869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:29.975817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:29.976707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 321/633] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:29.977842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:29.977842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:29.977842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:29.997116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:29.998311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:30.000569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.032399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f6005-4dca-4262-8ade-44490a2a9b05 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.068518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.069126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.069403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.069673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.070317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:30.070615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.072027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.072722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 322/634] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:30.073614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.082255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 313/635] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:30.082928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.140151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.185631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015cdd8-a01f-4373-970b-75073885c107 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.193322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbadf48-596b-4d1e-b816-0d6af0fd3027 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.225328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.225873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.226149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.226491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.230827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.231458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.231770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.232005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.232681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:30.232982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.234118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.234641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326408c-a47d-48c2-8036-a5e44f78ac9a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.235616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.238384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:30.248131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:30.249086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:30.249980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:30.250410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 314/636] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:30.250410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48bfe-fda5-4c96-b4f5-f3a49b37793b None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.250410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48bfe-fda5-4c96-b4f5-f3a49b37793b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.250410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc48bfe-fda5-4c96-b4f5-f3a49b37793b None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.258939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 323/637] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:30.259088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 315/638] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:30.259188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.259359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48bfe-fda5-4c96-b4f5-f3a49b37793b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.369976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d982c-fd69-438c-a3f7-919782e8188c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.373167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc48bfe-fda5-4c96-b4f5-f3a49b37793b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.387750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.404223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.404852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.405131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.405401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.409271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.409871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.410148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.410419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.411130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:30.411472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.412943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2fac-c548-41d0-9d54-0eb451ea8c6e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.416156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.418625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.419647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 316/639] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:30.420895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.421196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.421445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:30.437146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:30.438185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:30.439716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:30.439716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:30.439716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:30.439716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 324/640] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:30.439716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.445861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:30.447120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:30.499771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.535830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 317/641] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:30.536888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.561212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998116f6-603c-4dde-8a7e-687345319502 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.602953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.603748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.604656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.605845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.606651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:30.607059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.608668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.623687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 325/642] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:30.624694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.665940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd5363-f773-4719-8785-fc4f07272c43 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.678912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.719248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.720385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.720864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.721415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.734802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:30.740602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:30.741614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 318/643] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:30.743196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.769150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0587b-55d3-4607-aeea-afa033ee450d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.786263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:30.819889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.820507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.820784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.821074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.821679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:30.821978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.823711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.836806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 326/644] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:30.838026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.875398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab172ea-52ea-4158-b704-3866c5a57231 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.923065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:30.924828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:30.925842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:30.926797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a0a463d7f5db49fe9de8bb390363ba5b/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:30.945014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=a0a463d7f5db49fe9de8bb390363ba5b, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:30.946755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:30.961588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fae01f-463f-4a6e-b787-41f21e2a6782 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:30.967368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 319/645] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:30 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a0a463d7f5db49fe9de8bb390363ba5b/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:30.967368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:30.995088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.018454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.019446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.019767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.020183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.020947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:31.021345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.022910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.034096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 327/646] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:31.035202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.082608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.121924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16293c1-0ee4-4779-a33b-cfe3bbdcb8f0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.171024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.171892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.172296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.173007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.183862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ec99-3ae5-4a04-91b9-90ebbbcfe3a3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.187552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:31.192848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:31.194181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:31.195738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 320/647] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:31.196789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.237181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.238180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.238540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.239522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.254583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.257087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:31.275649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:31.276705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 19 11:01:31.277640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:31.281027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 328/648] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:31.282060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.298201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.324546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cc45e-d7d3-4341-9958-2d89189d5703 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.361756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.362781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.363310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.363780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.375590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.377406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:31.394085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:31.395083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:31.395992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:31.395992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:31.395992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:31.396681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809a340-2096-453e-b264-b80adb9614c0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.398360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 321/649] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:31.399448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.399897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.439285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.439926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.440204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.440485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.441783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:31.442089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.443521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.458010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 329/650] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:31.458937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.515390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d846-3f91-4857-912b-eacf6d65f8af None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.548749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.554836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.555788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.556266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.556754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.557913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:31.558594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.560296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.570744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffcbb5-1a39-46cc-b765-5089c4684125 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.587538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 322/651] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:31.588268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.614345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.615332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.615812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.616371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.617192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:31.617726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.619471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.632846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 330/652] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:31.634075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.652067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.704484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeb5d9-879b-4c58-8b40-6e0a7bdc5fe8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.745234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec7c9c-e9e6-4684-a390-afe1f9523c2d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.745585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.746233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.746525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.746800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.760258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.762840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:31.784320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:31.785356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:31.786356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:31.786356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:31.786356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:31.790303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 323/653] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:31.791187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.791336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:31.792298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.792785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.793257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.848431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.871700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.873631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:31.898371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:31.939120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4874ddb-1c47-46bd-a6fa-6376112b5673 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:31.982307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:31.983394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:31.983903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:31.984376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:31.993770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:31.995736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.005706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 331/654] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:32.005706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:32.014777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:32.015759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 19 11:01:32.016710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:32.019828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 324/655] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:32.020821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.120863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cdf44-ed52-4416-8b22-15ef44483cc9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.136646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.156547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.159549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.160356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921366f-b9a1-496a-97ad-291dbfe05300 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.160752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.161262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.161748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.162597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:32.163102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.164727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.178094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 332/656] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:32.179520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.213083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.214394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.214687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.214964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.227633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.229972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:32.245237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:32.246379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:32.247297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:32.247297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:32.247297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:32.253689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 325/657] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:32.254836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.304941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f4cc8-a3c4-4f6a-9956-bc86a0544d55 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.345383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.345997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.346281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.346558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.347447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:32.347756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.349423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.370315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 333/658] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:32.371380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.403664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d6bdd4-00e9-4712-b0a2-6d11dc86ee42 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.409829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.443402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.444057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.444337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.444674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.453630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.455041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:32.468169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:32.469189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:01:32.470145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:32.474079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 326/659] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:32.475179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.494110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.502521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e50b-b733-4a4d-a2fd-d73707a95cab None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.541169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.542154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.542438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.542717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.543403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:32.543713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.545126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.558595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 334/660] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:32.559587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.605433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bacfd-2860-42d7-b31b-2dad3b15a946 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.647421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.648174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.648526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.648872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.673556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.688110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4d9d9-fb85-4813-b8cf-7c896000801f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.735240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.736121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.736932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.737038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.737487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.737928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.738819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:32.739438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.741579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.757083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.765924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 335/661] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:32.767204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.864516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 327/662] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:32.865969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.887838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c14098-f54b-45b4-856f-9190df89adf6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:32.932289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:32.933448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.933723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.933993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.942067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:32.943593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2c44470e-fa35-48ac-8574-d5e2ae094fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:32.955801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:32.956749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:32.957796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:32.959464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 336/663] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:32.961583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfae3-77a4-4b10-ae94-c35fa5ec9f2f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:32.962065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfae3-77a4-4b10-ae94-c35fa5ec9f2f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:32.962401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588cfae3-77a4-4b10-ae94-c35fa5ec9f2f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:32.964705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 337/664] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:32.965398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cfae3-77a4-4b10-ae94-c35fa5ec9f2f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:32.980528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:32.987473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05d50-315b-404f-ab12-7bd3074736d7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.001949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.024736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.025338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.025741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.025939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.082287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588cfae3-77a4-4b10-ae94-c35fa5ec9f2f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.102143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.103644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb9016-07e9-472e-b58c-6241e23de023 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.118702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.119371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.120222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.120504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.130938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.132442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:33.147716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:33.148730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:33.149615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:33.149615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:33.149615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:33.149615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 338/665] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:33.149615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.224103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.226737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:33.228277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.228669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.228946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.251681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:33.252869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:33.262302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.272129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa050ae-b767-4f7f-b168-3a5f6046fbc2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.310847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.311499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.311833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.312051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.312738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:33.313080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.314500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.328072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 339/667] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:33.328800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.331818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 329/668] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:33.332912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.456907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bba4bb-1434-4da5-b9c0-993e659be246 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.457108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7312b36-3914-49cb-8c67-8b34355164c5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.497722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.514928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.515847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.516240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.516354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.516717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.517183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.517635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.518099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.519136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:33.519637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.521802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907aa76-369e-4895-b4f0-40be21b0bfc9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.533798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.536120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.540254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 340/669] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:33.540493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.543715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c3e9-ff05-4af0-8d25-6b9d93f3e4b6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.544199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c3e9-ff05-4af0-8d25-6b9d93f3e4b6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.544686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c3e9-ff05-4af0-8d25-6b9d93f3e4b6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.551458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 341/670] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:33.551458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c3e9-ff05-4af0-8d25-6b9d93f3e4b6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:33.562605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:33.564134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:33.565049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:33.565049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:33.565049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:33.565049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 330/671] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:33.565049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.664207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c3e9-ff05-4af0-8d25-6b9d93f3e4b6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.672292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a47c92-c7c1-44d7-b5f7-bf9e417b4fa3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.700594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.701198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.701477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.701751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.702467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=12546450f8af46a3816cd8e75e9d3ed2) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:33.702774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.704259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9437-9c4e-4780-8079-8e1daba7eb8b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.706824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.707492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.707815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.708140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.710215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 342/672] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/role_assignments?user.id=12546450f8af46a3816cd8e75e9d3ed2&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:33.711468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.711760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.712032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.729532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.731637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.737850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:33.738344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:33.747808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:33.749193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:33.750183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:33.751334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:33.752446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.801429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.829879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:33.841205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 343/674] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:33.841205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:33.904638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8c96d-c044-4ab7-88f1-dd0ac438d5f0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.951518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:33.952252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:33.952605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:33.953010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:33.953853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:33.954349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:33.955770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:33.960974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83137e3a-97dc-42f7-b616-e6383e4a5e40 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:33.972290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:33.972949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.001273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.001837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.002119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.002488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.017174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:34.022092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:34.023072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:34.023967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 344/676] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:34.024719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.085400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.093028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88843de2-85c7-4714-a7fa-6361520032f7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.108676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.130561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.131401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.131682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.131956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.132651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.132955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.134393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.148377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 333/677] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.154668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.158432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144bf2e-f9ea-4ad4-921f-3e791eb14f5f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.195118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.195781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.196059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.196330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.204146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.205624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:34.217686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:34.218674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 345/678] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:34.219612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.276934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b180a49-5a6e-4453-ac36-ebeda83c8165 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.325456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.326045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.326323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.326595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.327292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.327597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.328980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.329091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.336874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e6583-81f5-4243-b21f-361f68cbd4c2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.340290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 334/679] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.341421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.377083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.380510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.381158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.381438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.381710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.394428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:34.400250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:34.401917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:34.402798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 346/680] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:34.404010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.454333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412507-6f56-4a8c-ae23-2d47634b500b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.493903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.495263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.495569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.496299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.497031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=478e89a2c7c74b65a7008a49b08ef93a) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.497348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.498788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.506537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 335/681] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/role_assignments?user.id=478e89a2c7c74b65a7008a49b08ef93a&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.507392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.522537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e663f9a-9b3a-466e-bac7-626c61b06131 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.584163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.585394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.585886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.586727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.589181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.590048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.592496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.614337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 347/682] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.615638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.642745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.645554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.649815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8e891-103e-4115-a517-8a9a99395da3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.694377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.695092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.695506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.695787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.708969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.710632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:34.728708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:34.730621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:34.731561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:34.731561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:34.731561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:34.735614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 336/683] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:34.736221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.798630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7b3fd-b580-49ec-b35d-e02df188cf83 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.848960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.850011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.850487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.850955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.851886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.852644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.855001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.865541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 348/684] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.866676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.870295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916cca6-5f72-403c-be29-684663525d6e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:34.907097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:34.907507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:34.907741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:34.908020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:34.908752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=7968f762514f42df8264f5cbd1eb37ec) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:34.909069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:34.910554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:34.918164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 337/685] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/role_assignments?user.id=7968f762514f42df8264f5cbd1eb37ec&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:34.919218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:34.938805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:34.976537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.007439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb13a-8932-440a-acbf-f0b54c97fdf6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.053280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.054508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.055008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.055562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.056426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:35.057069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.059308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.075471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 349/686] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:35.082369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.178142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227baec-065d-4a85-b6b7-1a507b06d450 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.219436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63910bd-a0b9-4d96-b275-9cb92f5f6561 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.226030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.227083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.227751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.228254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.243380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.246794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.264671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.266200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.266200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.266200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:35.267215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:35.268176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:35.269067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:35.269067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:35.269067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:35.274854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 338/687] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:35.278611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.278611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.287319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:35.297426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:35.298423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 350/688] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:35.300001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.304662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.372977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.413134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e26c0e-642c-4e26-a154-ddd005cd2ab9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.422779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0eee1-2a93-431b-9650-4f2996e1f639 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.454021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.454984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.455577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.456205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.457046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:35.457543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.459218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.467704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.468319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.468596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.468863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.469981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:35.469981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.471608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.479693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 339/689] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:35.484345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.499587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 351/690] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:35.508246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.605100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbc0b3-4ba0-49fd-8918-c0b28810c705 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.637211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.648038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.649059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.649568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.650037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.662946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.684348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.685827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.705814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf5f87-6369-42b8-bbcb-0a8d93241a7e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:35.712703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:35.713835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:35.714794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 340/691] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:35.720577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:35.748455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:35.749068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:35.749348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:35.749614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:35.835264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:35.837084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:35.947544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:35.979365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642bba0-999d-4b38-b5e0-23e112ecd1ed None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.027119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 352/692] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 19 11:01:36.033267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.064992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.065926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.066208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.066557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.067240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:36.067547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.069043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.112618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 341/693] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:36.118128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.153420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a70632-399b-47b2-bdf7-10966105c6a3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.196937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.197576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.198068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.198558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.207548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.210972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.212831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9a172c4b-5d6c-4c99-8f48-75d2a5e446b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:36.233269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:36.234688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:36.235659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:36.235659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:36.235659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:36.235659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 353/694] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:36.240298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0886c-66b8-48ec-9401-0336c0e41d7e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.240626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0886c-66b8-48ec-9401-0336c0e41d7e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.240902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0886c-66b8-48ec-9401-0336c0e41d7e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.247484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 354/695] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:36.247484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0886c-66b8-48ec-9401-0336c0e41d7e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.259524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.280759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f56443-3255-4ccc-99ec-154c6fa1729b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.320988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.321751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.322139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.322535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.379599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0886c-66b8-48ec-9401-0336c0e41d7e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.397922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.399561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.425306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.426789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.427490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.428085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.429438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:36.430122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.431770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8942413-757a-4fdd-b52c-0d2575c47593 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.453638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 355/696] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:36.455515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.456192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.456727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.467687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.478268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:36.480636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:36.517030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 342/697] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 19 11:01:36.518067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.561389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.568180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 356/698] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:36.569215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.685403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01252-12e6-49b6-99d8-6c150645e345 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.723398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286d764-c108-475e-b968-5d4b89408fb8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:36.766783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.769259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.769714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.771342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.788061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.789489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.796904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:36.797780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:36.798212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:36.798630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:36.809779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:36.811602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:36.814147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:36.815269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:36.816665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:36.823938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 343/699] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:36.833197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:36.837481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:36.838768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:36.840292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:36.840292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:36.840292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:36.843473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 357/700] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:36.847896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.852619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:36.917915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:36.982215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003745bb-4891-4cc6-a9e0-d250984dfd8a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.029263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7cddb-e587-46f2-bae8-ef0bd3721022 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.046952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.048421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.049151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.049610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.050789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.051573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.052977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.073804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 358/701] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:37.075280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.076947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.077687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.078122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.078649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.079528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.079842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.081715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.099568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 344/702] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:37.099568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.179538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.208046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515d35c-468f-4e88-8d76-167e427dddd8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.220059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.226067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5cbd3-c658-434f-8452-5a95ee197d88 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.248111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.248813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.249037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.249314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.260436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.261976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.267325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.268189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.268678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.269122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:37.278116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:37.279121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:37.280582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:37.280582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:37.280582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:37.280582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 359/703] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:37.280582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.282132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.284003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a69313e2-bf04-4815-b9ea-cd758ec2e357 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:37.300904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:37.302737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:37.304638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:37.306831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 345/704] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:37.309253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42fd0-ed72-4a9b-8632-3ee7fa240172 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.309716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42fd0-ed72-4a9b-8632-3ee7fa240172 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.310067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a42fd0-ed72-4a9b-8632-3ee7fa240172 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.315320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 346/705] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:37.316882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42fd0-ed72-4a9b-8632-3ee7fa240172 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.423114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510d4b7-6c6d-4313-85ae-989d9548b582 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.430126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a42fd0-ed72-4a9b-8632-3ee7fa240172 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.460576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.461178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.461470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.461724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.462325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.462438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.462736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.464311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.470437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 360/706] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:37.473159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.473776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.474051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.474323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.474964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.475303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.476716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839bb1e-1185-47cd-bbe7-bbdb8e566143 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.481493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.497546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 347/707] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:37.497546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.497546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.497546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.517085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:37.518311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:37.535302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.611679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 348/708] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:37.612703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.654515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3373f-9708-41ac-9386-5ca079d99962 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.706240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.706880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.707246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.707464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.708166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.708673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.710437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.729531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 361/709] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:37.740230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.763991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96903d99-9223-48d8-809f-87a6cb8b6d47 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.783595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.810584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.811126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.811447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.811717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.812925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.814406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e567b60-86ab-4df8-a5ea-1736a6d96e8a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.843842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 349/710] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:01:37 2022] POST /identity/v3/users => generated 254 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:37.845454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a2ea-6b35-4c30-a516-1925bb075047 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.845738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a2ea-6b35-4c30-a516-1925bb075047 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.846147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a2ea-6b35-4c30-a516-1925bb075047 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.851455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 350/711] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:37.856765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.857104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.857378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.873399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:37.879879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:37.881632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:37.894172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b88c3-45df-4ff1-a741-0625398cfe70 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:37.944282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:37.945569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:37.946006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:37.946758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:37.948958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a0a463d7f5db49fe9de8bb390363ba5b) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:37.949453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:37.952138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:37.960769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 362/712] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/role_assignments?user.id=a0a463d7f5db49fe9de8bb390363ba5b&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:37.961884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:37.987648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 351/713] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:38.144606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e25d4-696d-4503-bd58-a47b687c656a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.186406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.187056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.187409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.187683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] PATH_INFO: `/v3/services/network` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.188339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.189764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:38.204013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:38.205414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.206503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 363/714] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:37 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:38.211174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:38.292232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:38.312678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:38.336855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d59dc-5664-43bf-bb76-31ae64c76af2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.338854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:38.380337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.380960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.381239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.381513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.382261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:38.382569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.383989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.390060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 352/715] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:38.396127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:38.426785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59cd72-a8d3-4e54-b287-166a0a29cb76 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.480936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.481584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.481863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.482137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.482722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.484391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:38.502987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:38.504070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:38.504906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:38.505857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 364/716] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 19 11:01:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:38.512723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:38.545975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509323fd-a451-42a6-833d-d7196260e4e4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.615972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.616599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.616878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.617148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.617787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] RBAC: Adding query filter params (type=network) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:38.618090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.619730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.636404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 353/717] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:38.660138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:38.687379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce099f-807c-4a66-b73a-0c7c595be581 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.734245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.734864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.735227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.735506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.736141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:38.736443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.738052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6b14c-799f-4785-ae0f-c2573c191669 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.748289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 365/718] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:38.753756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:38.793630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:38.879991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093f7c0-0c7b-4355-9b11-a6bd79390808 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:38.930865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:38.931446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:38.931727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:38.932061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:38.933214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:38.933608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:38.935016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35635385-6b67-4e45-94e1-4e0c07c12f3e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:38.942450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 354/719] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:40.018364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61357b49-5e3e-4ad4-915a-e220774b7890 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.018994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61357b49-5e3e-4ad4-915a-e220774b7890 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.018994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61357b49-5e3e-4ad4-915a-e220774b7890 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.020512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 366/720] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:40.026664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.027210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.027660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.052011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:40.053800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:40.158119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 355/721] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:40.528554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61357b49-5e3e-4ad4-915a-e220774b7890 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:40.681166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61357b49-5e3e-4ad4-915a-e220774b7890 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:40.719034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:40.719709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.719989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.720260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.731892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-73e59ca6-08f4-4338-a3cb-f00d2101e0fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:40.736997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:40.738086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:40.738958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 367/722] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:40.747280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:40.799362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:40.882516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa79c85-0e6e-4456-9067-560d07dd1be5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.883207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa79c85-0e6e-4456-9067-560d07dd1be5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.883713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa79c85-0e6e-4456-9067-560d07dd1be5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.885695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 368/723] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:40.891448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61f16a-8b52-4a11-b812-0be45be31e49 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.892010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61f16a-8b52-4a11-b812-0be45be31e49 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.892559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61f16a-8b52-4a11-b812-0be45be31e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.899853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:40.914316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8e61f16a-8b52-4a11-b812-0be45be31e49 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:40.916006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8e61f16a-8b52-4a11-b812-0be45be31e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:40.923207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617af4d-5959-4677-af1c-76d78b7f29f5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:40.980728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:40.981268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.981544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.981870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.982544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:40.982845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:40.984490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8d652-b202-4e50-a008-500dd231b5fe None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:40.995072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 356/724] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:40.996762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1efdf-64fe-47f1-a0d2-6586d756936c None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:40.997144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1efdf-64fe-47f1-a0d2-6586d756936c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:40.997517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1efdf-64fe-47f1-a0d2-6586d756936c None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:40.999126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 357/725] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:41.004162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1efdf-64fe-47f1-a0d2-6586d756936c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.020961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 369/726] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 19 11:01:41.027353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.027353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.027353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.058911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:41.061533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:41.174498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 370/727] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:41.182131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:41.213969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1efdf-64fe-47f1-a0d2-6586d756936c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:41.263862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:41.264477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.264757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.265031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.296827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:41.298457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:41.317528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:41.318532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:41.319637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:41.319637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:41.319637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:41.319637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 358/728] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:41.327100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.400447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.425006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:41.513164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390433d2-73a4-421c-ad26-5bec1d93e78e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:41.566341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6382c-f5e7-4e62-95f8-08cda64d33de None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:41.621443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:41.622166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.622447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.622718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.631573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:41.638361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:41.643906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:41.644913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:41.645924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:41.650220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 359/729] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:41.651954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.677121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:41.678115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.678662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.679256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.680250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:41.680760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:41.683816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:41.699623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 371/730] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:41.700936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.784537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642b8d-6af7-4dc8-89e8-afcda7349230 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:41.813660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78684b44-ae50-4489-99a8-67664438a855 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:41.830930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:41.831489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.831770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.832045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.843507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:41.846559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:41.848759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:41.849915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 360/731] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:41.850769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.868976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:41.870381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.870702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.870967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.871872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:41.872196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:41.873974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9529-5fe7-4a23-b6b0-ef77b92a97f4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:41.891539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 372/732] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:41.893311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1eb4d-748d-4499-bcb2-60145023d445 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:41.893591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1eb4d-748d-4499-bcb2-60145023d445 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:41.893879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1eb4d-748d-4499-bcb2-60145023d445 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:41.895454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 373/733] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:41.900201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1eb4d-748d-4499-bcb2-60145023d445 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:41.933443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:41.988122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea35a-48e4-4f6c-b1b1-95d1a4daff6d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.027338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1eb4d-748d-4499-bcb2-60145023d445 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.032946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.033797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.034229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.034652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.045315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.047053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:42.060009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:42.061107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:42.062228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:42.064131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 361/734] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:42.065243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.070743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.071393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.071672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.071939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.072707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:42.073207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.074767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c92031-bfe4-476e-8070-ce1a3e20faaf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.083810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 374/735] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:42.084992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.085275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.085546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.107213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:42.108669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:42.151729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.177680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 375/736] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:42.178507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8df5-9aad-4993-8c7e-1ecdac0380e8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.178749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.205605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.224910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.225539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.225823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.226093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.238003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.239499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:42.253955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:42.254947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:42.256212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:42.256212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.256212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:42.256212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 362/737] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:42.256212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.295729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb77a37-9da1-4ec3-aa18-872b41136a24 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.335689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.336221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.336499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.336767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.337486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:42.337784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.339282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3840f-b8e1-4b2b-88f0-d14a004c8c8e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.356862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 376/738] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:42.358101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8155-7849-4f11-ad50-dfa6c62f40d7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.358382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8155-7849-4f11-ad50-dfa6c62f40d7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.358728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de8155-7849-4f11-ad50-dfa6c62f40d7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.360216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 377/739] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:42.360925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8155-7849-4f11-ad50-dfa6c62f40d7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.377129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6012c-c6a9-43b0-a3b5-b035473d047e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.400192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.418861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.419995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.420209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.420643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.434239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.435970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:42.454357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:42.455607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:42.456515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:42.456515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.456515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:42.456515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 363/740] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:42.457301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.480496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de8155-7849-4f11-ad50-dfa6c62f40d7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.484551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.517428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.518038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.518346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.518624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.519304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:42.519613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.521071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d22d1b-7521-46a8-92d5-96c4ec04d79b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.532971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 378/741] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:42.534194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.534477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.534754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.553246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:42.554440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:42.571635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c5055-757c-4956-a64b-c97fc09ddc09 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.610509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.611059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.611375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.611653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.622818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.623134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 379/742] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 19 11:01:42.623999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.624322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:42.643204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:42.644224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:42.645116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:42.645116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:42.645116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:42.645116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 364/743] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:42.645116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.661093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.730275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.746741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e00bf1-5421-47f4-b687-971a8b21c4d1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.760426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863bde4-aa3e-4cba-9c73-b4fa005807bd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.784327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.785020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.785370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.785719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.786435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.787919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.802142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:42.803009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:42.803466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:42.803896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:42.804669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:42.805121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:42.806632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:42.808114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 380/744] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:01:42 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:42.809007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.830468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 365/745] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:42.831636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:42.953664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:42.959576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91687b62-6334-4c12-b507-e119fc86daa2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:42.982196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88827e90-a57b-4502-b7d7-1f0217dbeef0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.000448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.001069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.001335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.001609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.002376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:43.002555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.004632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.005563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.018513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 366/746] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:43.019494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.029444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.030082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.030356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.030632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.038430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.039960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:43.059383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:43.060771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 381/747] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:43.062116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.141422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baea7f6-f7c3-449e-aa1f-49e0d923821b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.174971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3edd-667f-4eab-a98c-27f1b188781d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.178068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.178783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.179059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.179359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.189395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.191500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:43.204298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:43.206180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:43.207366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 367/748] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:43.210616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.217292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.218047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.218446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.218813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.219603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.221099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.232520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.238640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 382/749] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:01:43 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:43.239591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.289688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.360837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b833747-37d5-4b7d-993b-9186a25e39a9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.381549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d6441-f097-4def-80de-3696ed641a52 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.404641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.405297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.405575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.405846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.414643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.416926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.429823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.430824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.431409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:43.431928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:43.432876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:43.433888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:43.434765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 368/750] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:43.434963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.435413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.436249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:43.436757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.438782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.462753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 383/751] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:43.464373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.539013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.583544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a764-d740-4d7e-8c3c-76dc04ca1b79 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.589799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86cd75-e782-478a-941a-c0fe1b5554e8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.602602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.628564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.629179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.629462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.629824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.630263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.630561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:43.630868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.631029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.631397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.631731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.632356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.632536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:43.632902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.634397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.647617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 384/752] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:43.648598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.659587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 369/753] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:43.660491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.768851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162bb09-78cf-497b-87c0-c500d2011492 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.784974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:43.792401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea92e8e-98b4-4b13-adf1-d7a2c01a2291 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:43.809457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.810226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.810603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.810965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.840703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:43.841916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:43.842783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:43.843239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:43.845772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=a8f507682b7f425ba842a46ad98d9dae, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.847399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.875437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 370/754] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:43 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:43.875437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:43.917775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:43.920704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:43.952280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:44.086779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 385/755] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:01:44.092701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.100581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db770bf-2232-4896-b46a-8d623c61e649 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.115407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:44.149213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299c446-269a-4019-abea-967a554add07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:44.149943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c446-269a-4019-abea-967a554add07 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:44.150225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c446-269a-4019-abea-967a554add07 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:44.150519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299c446-269a-4019-abea-967a554add07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:44.247801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299c446-269a-4019-abea-967a554add07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:44.249286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299c446-269a-4019-abea-967a554add07 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:44.264938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92293be-4013-433d-bbf2-63631f0ebc5c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.317659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:44.344961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:44.345524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:44.345874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:44.346209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:44.372151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:44.373634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:44.395030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:44.396236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:44.397124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:44.397124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:44.397124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:44.403850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 386/756] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:44.409351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.431426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 371/757] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:01:44.437557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299c446-269a-4019-abea-967a554add07 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.527446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:44.590341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db75dd-99c3-403f-936a-ff8dfdabd460 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.617104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299c446-269a-4019-abea-967a554add07 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.653917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:44.654644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:44.654967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:44.655264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:44.655908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:44.656208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:44.657597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:44.678306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 387/758] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:44.679519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:44.685754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.687779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:44.688435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:44.688712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:44.688985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:44.708552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:44.710034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:44.736009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:44.737020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:44.737904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:44.737904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:44.737904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:44.737904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 372/759] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:44.744367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.857791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b4be6-d3e2-4139-91f3-cf0d51d384e2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.897370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:44.898410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:44.899130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:44.899606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:44.900418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:44.901453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:44.903051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:44.920217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 373/760] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:44.929549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:44.935536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24129ffc-2ca2-4aad-8cbe-eb3d27fdd9e4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:44.985375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:45.001740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.005907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.006437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.006882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.022965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.023591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:45.025704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:45.046415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:45.047453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:45.048672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:45.055854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 388/761] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:45.062972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:45.127382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f8be-f13b-41ee-8c90-08da8d339a5e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:45.171017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.171605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.171884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.172156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.186929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.188430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:45.216113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:45.217067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:45.217998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:45.222063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 374/762] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:45.228065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:45.258282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ab699-b001-4262-ba1e-1745dfbc919c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:45.331911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.332528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.332806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.333080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.333770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:45.334074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.335548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aea55f-f985-4ed0-9d38-d1a6cf8d3a96 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.353181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 389/763] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:45.354600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b813-9277-42a0-96f5-b5edde3b6d68 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.354891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b813-9277-42a0-96f5-b5edde3b6d68 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.355197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b813-9277-42a0-96f5-b5edde3b6d68 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.356727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 390/764] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:45.357449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b813-9277-42a0-96f5-b5edde3b6d68 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:45.398018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a1ed6-68ad-4331-ae4e-82ead80b6e5a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:45.403662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:45.414608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:45.438886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.439880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.440364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.441083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.441961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:45.442480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.444222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6f4ce-feba-4a7a-8d7b-051b0cee7ba2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.463542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 375/765] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:45.465168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376070-94ba-4ea7-9ada-57b30dacf424 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.465603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376070-94ba-4ea7-9ada-57b30dacf424 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.466024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376070-94ba-4ea7-9ada-57b30dacf424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.480136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b813-9277-42a0-96f5-b5edde3b6d68 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:45.485191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-13376070-94ba-4ea7-9ada-57b30dacf424 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:45.486593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-13376070-94ba-4ea7-9ada-57b30dacf424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:45.521220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.522040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.522421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.522816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.523778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a0a463d7f5db49fe9de8bb390363ba5b) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:45.524938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.526133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.532425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 391/766] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:45 2022] GET /identity/v3/role_assignments?user.id=a0a463d7f5db49fe9de8bb390363ba5b&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:45.539542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:45.561513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 376/767] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:45.695751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c39bf-adcb-4128-8f6d-8f362c357176 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:45.715664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:45.744737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:45.745311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.745591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.745868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.746593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=1fa0b90d101249b0803066fd7604aa84) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:45.746900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:45.748396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a7557b-0075-40b8-8872-d1220e044258 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:45.754922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 392/768] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:45 2022] GET /identity/v3/role_assignments?user.id=1fa0b90d101249b0803066fd7604aa84&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:45.889247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9130-dff4-4027-97db-b568daeea50b None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.889615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9130-dff4-4027-97db-b568daeea50b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.889806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f9130-dff4-4027-97db-b568daeea50b None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.891604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 377/769] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:45.897592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:45.897926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:45.898286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:45.925036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:45.926253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:45.954444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9130-dff4-4027-97db-b568daeea50b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.026334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 393/770] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:46.061318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:46.069498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f9130-dff4-4027-97db-b568daeea50b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.106177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.106808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.107088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.107392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] PATH_INFO: `/v3/services/network` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.107969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.109346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:46.120953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:46.122013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.122875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 378/771] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:45 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:46.128366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.327403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c704142-7ad4-498c-b8ef-e5a3921f7f9b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.329879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:46.381015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.386103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.386999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.387508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.387995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.388817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] RBAC: Adding query filter params (name=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:46.389332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.391212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.396976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 394/772] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:46.402546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.509709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4b62-5f0c-4fbb-880f-d993459a3772 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.518361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd0156-81d6-4e34-b9e5-9938b92ce307 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.549021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.549566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.549932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.550215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.550793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.552223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.559688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.560722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.561225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.561729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.562551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] RBAC: Adding query filter params (type=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ffd9650e-ecdc-44ce-9aee-da04b7130158 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:46.562864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:46.563833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:46.564700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 379/773] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:46.566019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787e05-5faf-4b41-b4c1-5cc57be24b37 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.566110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787e05-5faf-4b41-b4c1-5cc57be24b37 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.571450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88787e05-5faf-4b41-b4c1-5cc57be24b37 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.572030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.572153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 380/774] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:46.573636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88787e05-5faf-4b41-b4c1-5cc57be24b37 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.574130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de18ed0-3fba-45cf-87ac-af42654bdbea None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.587644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 395/775] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:46.590299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.590823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.591343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.607757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:46.614862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:46.616460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:46.647126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:46.701133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88787e05-5faf-4b41-b4c1-5cc57be24b37 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.711235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 396/776] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:46.712443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.766084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.767099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.767901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.768411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.769283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:46.769793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.771452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.778015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 381/777] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:46.784282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:46.888831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:46.907636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864942-47fa-4939-9794-8c2e6818baf2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.938277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192be149-1111-4193-9ce2-b81e7006ed8d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:46.975864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.976814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.977295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.977767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.979218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] RBAC: Adding query filter params (interface=public, service_id=97180461d9b14ae4b5ccda38264d6c6d, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:46.979753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:46.981386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:46.990043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 397/778] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/endpoints?service_id=97180461d9b14ae4b5ccda38264d6c6d&interface=public®ion_id=RegionOne => generated 194 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:46.991881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:46.992731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:46.993307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:46.993822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:46.995246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:46.996592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.000118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.002327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.015211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 382/779] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:47.032983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.036586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:47.123368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ac03f-acd3-4856-a585-9564afb6b5e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.158745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26fbd59-8115-4cb8-ac52-54ed52816018 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.172234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.172956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.173302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.173644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.174712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.176949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.187196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 398/780] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:01:46 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:47.187196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.222600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.223660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.224121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.224611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.225490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] RBAC: Adding query filter params (interface=public, service_id=2d46e6ac92fc418e954198fd07fadc11, region_id=RegionOne) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:47.225975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.227590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.249305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 383/781] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/endpoints?service_id=2d46e6ac92fc418e954198fd07fadc11&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:47.254391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.290040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:47.338481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:47.351667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97bbd0-2ecb-4aa0-a805-5635ccf0ea45 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.396813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.397711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.401438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.401996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.429989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:47.439565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:47.440892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:47.441949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:47.444881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 399/782] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:47.455851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.473277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e148b-631b-45df-a7d1-fcddfa74999b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.516801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.517576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.517958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.518339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.519254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.520846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.527823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 384/783] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/services => generated 772 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:47.591572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ccbd-35fe-49fe-b80b-4030939ff11b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.633057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.633966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.634393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.635409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.636391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:47.636835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.638709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.650793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 400/784] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:47.656691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.765901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:47.791612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312fd81-a185-4e8a-9f90-d33b17c292df None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:47.829980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:47.830630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:47.830909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:47.831216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:47.842739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:47.844259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:47.861530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:47.862560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:47.863667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:47.863667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:47.863667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:47.863667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 385/785] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:47.868913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:47.885158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:47.999976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a45c0-532a-4440-9675-3469359352b8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:48.056685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:48.057228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.057508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.057789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.058435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:48.058740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:48.060176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427aa15-e972-4178-95ee-91099898f488 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:48.080300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 401/786] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:48.086132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:48.200957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026c1f5-57e7-4a2d-9218-e56946ba6fb2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:48.202209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e5a6-82e3-4cef-8853-621b5bfcb9da None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.202499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e5a6-82e3-4cef-8853-621b5bfcb9da None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.202773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620e5a6-82e3-4cef-8853-621b5bfcb9da None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.204298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 402/787] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:01:48.209327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0189-525a-4594-84ca-2a3b890dda9b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.209609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0189-525a-4594-84ca-2a3b890dda9b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.209890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0189-525a-4594-84ca-2a3b890dda9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.232905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-362f0189-525a-4594-84ca-2a3b890dda9b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:48.234847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-362f0189-525a-4594-84ca-2a3b890dda9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:48.238678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:48.239358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.239641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.239913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.243470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:48.249732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:48.251220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:48.264329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:48.265434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:48.266447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 386/788] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:01:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:48.271312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:48.378661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 403/789] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:48.438836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5e66-a44f-488b-9d5b-b5f8f24dd084 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.439595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5e66-a44f-488b-9d5b-b5f8f24dd084 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.440085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb5e66-a44f-488b-9d5b-b5f8f24dd084 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.442445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 404/790] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:01:48.448498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.449075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.449678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.459008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:48.468882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad0d93-806f-46f8-ac1d-0cd5737a8054 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:48.483705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:48.485258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:48.533614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:48.534968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.535600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.536103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.537030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:48.537541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:48.539390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:48.570761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 387/791] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:01:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:48.577018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:48.631337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 405/792] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:48.666700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:48.683401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:48.766382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bfc48-a50a-4a97-9da3-13b17e021d03 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:48.839920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:48.840983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.841595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.842187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.875210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa89c7a-ea9b-4b1f-90ce-f7c5beca260b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:48.940202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:48.948371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:48.949025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:48.949292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:48.949568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:48.958902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:48.960589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:48.961429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:48.966186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:48.967182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:48.968045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 406/793] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:48.973436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.062804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.116448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 388/794] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:01:49.117231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43b76e-07e5-46c1-acb7-49f656ff5886 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.117392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.172405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.173310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.173596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.173867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.174842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:49.175168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.177372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.189276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 407/795] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:49.190790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.239032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e8afd-0afe-4ead-ab59-2134e6990e33 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.265040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.295549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.296520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.297079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.297514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.309861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:49.316440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:49.317463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:49.318395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:49.321308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 389/796] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:49.322887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.324542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90522-b09c-4de7-953e-0de5b71d8d0a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.336557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.366815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.367636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.368011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.368378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.381137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.382874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:49.399620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:49.401041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:49.401961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:49.401961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.401961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:49.406294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 408/797] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:49.407323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.445630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc24db-fc85-41d5-bced-7a70c7137397 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.487429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.488402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.488876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.489331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.503143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.504941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.520754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5aa3-4de3-4e45-a139-7f195f05d4be None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:49.525146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:49.526314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:49.527256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:49.527256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.527256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:49.529092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 390/798] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:49.530219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.532282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.562565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.563705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.563705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.564015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.564793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:49.565194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.566952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.581613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 409/799] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:49.582298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.612108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.670792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4835-d546-4c14-ba4f-d875ebb77a24 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.703473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42f228-0757-447b-9bf7-ede8522eb784 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.719024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.720051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.720518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.721113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.721966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:49.722480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.724847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.741101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 391/800] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:49.742401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.750122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.750839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.751303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.751657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.752389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:49.752784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.754526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.769056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 410/801] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:49.770251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.802718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.877402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ec8a9-8329-4957-83d0-7775743cfe3b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.896106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed04f87-da73-4f47-a413-aac818903029 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:49.907739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:49.933529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.934513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.935280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.935769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.943570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:49.944317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:49.944724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:49.945082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:49.951238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.953023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:49.953549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.954848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:49.967798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:49.968757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:49.969634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:49.973951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 411/802] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:49.974217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:49.975138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:49.976383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:49.976383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:49.976383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:49.976568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:49.978940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 392/803] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:49.985321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.083899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.098707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975ffa0-a944-4902-b6f5-9b01dffe4c0a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.111514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103f2e4-f9a2-4b4b-b6d9-d56362fc67ed None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.135518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.136352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.136634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.137136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.145068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.146706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.153852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.154595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.154873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.155143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.155858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:50.156183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.157582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24d3ce-3098-411e-95f5-690e5432b029 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:50.159220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:50.160306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 412/804] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:50.161450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.175934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 393/805] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:50.177569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff0e2-eb34-4ca5-8b06-b53e003454f3 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.178065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff0e2-eb34-4ca5-8b06-b53e003454f3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.178550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ff0e2-eb34-4ca5-8b06-b53e003454f3 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.180046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 394/806] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:50.180977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ff0e2-eb34-4ca5-8b06-b53e003454f3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.216254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.280004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b13d4-7646-4bc1-a3a2-3cd585826c95 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.305880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ff0e2-eb34-4ca5-8b06-b53e003454f3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.321147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.321773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.322601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.322880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.323599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:50.323907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.325338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.343433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 413/807] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:50.343433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.353267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.357130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.357899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.358357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.358568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.359424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:50.359732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.361618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37ba60-96b6-438f-b42e-429b145e91e5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.382458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 395/808] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:50.383410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.383712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.383975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.404490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:50.405701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:50.461042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083e72f-89e0-4c32-bff3-468fa8e2ef4e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.485351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 396/809] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:50.486487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.504904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.505493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.505775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.506045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.506761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:50.507068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.508574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.509734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.527187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 414/810] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:50.527187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.616687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bc214-0515-461e-973d-7a251a5020d5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.630555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.661335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.662144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.662558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.662940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.671720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.673349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.676915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6c73b-0e3f-4c11-8eb1-4db23fbbf51e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-aceda2df-775b-4b17-8926-641d163d355d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:50.687217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:50.688247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:50.689342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 397/811] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:50.690210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198b6b-d796-4a91-b083-b830a1a5fe2b None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.690448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198b6b-d796-4a91-b083-b830a1a5fe2b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.690994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc198b6b-d796-4a91-b083-b830a1a5fe2b None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.696576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 398/812] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:50.697793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198b6b-d796-4a91-b083-b830a1a5fe2b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.726809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.727706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.728099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.728919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.741431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.742836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7e233670-035c-4e47-aafa-5d8699896e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:50.758598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:50.759763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:50.760655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:50.760655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:50.760655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:50.760825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 415/813] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:50.762419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.762532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.762981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.781970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:50.783203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:50.799243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:50.823302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc198b6b-d796-4a91-b083-b830a1a5fe2b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:50.860649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:50.861259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:50.861534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:50.861859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:50.862527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 416/814] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:50.862635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:50.862918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:50.864039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.865560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:50.890819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 399/815] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:50.892014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:50.939972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.005522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56f43e-b8d8-4a0f-a480-e12970c81401 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.009132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888c3cf-10ec-4c1e-92a8-5150d65743c5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.046898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.047331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.047610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.047882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] PATH_INFO: `/v3/services/network` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.048458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.049825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.057031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.057914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.058394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.058910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:51.059261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:51.060275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 19 11:01:51.061132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:51.063101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.063649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.065208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 417/816] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:51.065442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.066328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.075409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.084982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 400/817] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.086410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.185470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e400b3-1a52-4e01-b535-920c7fae2bff None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.203602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.210553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1c130-5432-48cb-82d1-cf45a2dd0e77 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.221875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.222504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.222779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.223049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.233932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.235420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.249068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.249681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.249960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.250238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:51.250412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:51.251538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:51.252861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:51.252861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:51.252861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:51.253033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] RBAC: Adding query filter params (name=network) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.253033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.253033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.256245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 418/818] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:51.257047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.262370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 401/819] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.262370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.327965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.368619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187cb67-8a74-46fe-99c5-f70831df7f80 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.373481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdf324-5dcb-4f68-bd53-1fea4ec69774 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.404799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.405483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.405718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.405990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.406568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.407976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.411841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.412490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.412770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.413040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:51.417350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:51.418328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 19 11:01:51.419213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:51.421364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.422889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.423499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 402/820] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:51.424210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:51.435988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:51.437085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 419/821] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:51.440136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.469811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.544073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533059f-ce97-4503-be59-9ea425ce34a0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.548183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2cc6df-f3bb-4889-a8ef-b208c3e4cd07 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.571193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.581267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.581878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.582160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.582438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.583100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.583400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.584739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.584854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.585340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.585619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.585893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.586510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] RBAC: Adding query filter params (type=network) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.586810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.588335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.598026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 420/822] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.598026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.602034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 403/823] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.607693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.701439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.709557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752916a-796c-44eb-be6b-20234de5cd46 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.718006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e204302-5a23-422f-9bd0-036cd9a88761 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.745838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.748542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.748826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.749101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.749768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.750069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.751492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.761500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 421/824] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.761500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.762630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.763277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.763582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.763854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.764551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:51.764861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.766649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.785100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 404/825] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:51.785100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.889484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c1d1b-c7c8-4526-ac74-f146fffce3bf None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:51.930818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:51.932000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:51.932287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:51.932750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:51.933421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:51.934926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:51.948551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:51.958888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 422/826] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:01:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:51.959973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:51.977958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:52.038500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895240f-8866-4426-9d38-4c1cab80b83b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.098657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.099528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.099902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.100267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.100702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d49a5c-ab35-4570-8ba9-a2f4dd747252 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.108777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.110521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:52.124188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:52.125364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:52.126454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:52.132959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 405/827] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:52.133978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:52.150731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.151912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.152360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.152777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.153908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:52.154362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.156709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.163573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 423/828] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Sep 19 11:01:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:52.164834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:52.263336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:52.273091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041356-3c0c-4480-9818-eeb474a18b8b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.275112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:52.294956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b027ed1-f627-4643-9143-eed5439b9347 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.318788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.319548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.319831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.320128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a0a463d7f5db49fe9de8bb390363ba5b/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.322558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=a0a463d7f5db49fe9de8bb390363ba5b, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.324035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.333988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.334610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.334892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.335247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.335877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:52.336180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.337616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.339964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 406/829] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:52 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a0a463d7f5db49fe9de8bb390363ba5b/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:52.341025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:52.360372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 424/830] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:52.366987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:52.476864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27fc27-3b0f-4e74-912a-d968d29f243d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.509976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3e70-7d41-4309-aa74-1d81b809dc37 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:52.526691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.527669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.528303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.528729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.530037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.532195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5386f-8423-416c-b4cf-b83aad5635d9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.556244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:52.557180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.557656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.558099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/1fa0b90d101249b0803066fd7604aa84/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.561110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:52.566057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 407/831] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:01:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:52.580260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=1fa0b90d101249b0803066fd7604aa84, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:52.581865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff368e-671c-4c16-a747-0cbc4e99f044 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:52.603225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 425/832] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:01:52 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/1fa0b90d101249b0803066fd7604aa84/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:01:52.861009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b252-cf47-4a52-8aa4-7d63b7f93b22 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.861520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b252-cf47-4a52-8aa4-7d63b7f93b22 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.861520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400b252-cf47-4a52-8aa4-7d63b7f93b22 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.863004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 408/833] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:52.868455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092611c9-c685-4b31-b99c-96672e87054f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:52.868749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092611c9-c685-4b31-b99c-96672e87054f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:52.869631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092611c9-c685-4b31-b99c-96672e87054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:52.890645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-092611c9-c685-4b31-b99c-96672e87054f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:52.891888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-092611c9-c685-4b31-b99c-96672e87054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:52.974941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 426/834] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:53.255943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b252-cf47-4a52-8aa4-7d63b7f93b22 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:53.278409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:53.372068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400b252-cf47-4a52-8aa4-7d63b7f93b22 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:53.410479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:53.411108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:53.411407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:53.411679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:53.412247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:53.413613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:53.422843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:53.423836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:53.424912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 409/835] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 19 11:01:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:53.430361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092611c9-c685-4b31-b99c-96672e87054f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:53.544119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092611c9-c685-4b31-b99c-96672e87054f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:53.558882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:53.594366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:53.595308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:53.595771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:53.596224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:53.597020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:53.597528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:53.599078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7d2e9-55ca-425d-8f90-4729798da629 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:53.604852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 427/836] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:01:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:53.610711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:53.699834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:53.716520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbf036-7281-404b-830d-71cde16663d3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:53.753182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:53.754178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:53.754637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:53.755139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:53.756098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:53.756575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:53.758114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6a54e-b16f-4cb7-b18f-82b98a31a36b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:53.764230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 410/837] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:01:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:54.717820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c219-de56-4180-9b77-652139615e62 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.718380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c219-de56-4180-9b77-652139615e62 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.718380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c219-de56-4180-9b77-652139615e62 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.720161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 428/838] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:54.725533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad73c2-0c67-4bbc-b0aa-703eb8c4cccf None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.725977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad73c2-0c67-4bbc-b0aa-703eb8c4cccf None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.726067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad73c2-0c67-4bbc-b0aa-703eb8c4cccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.748283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-daad73c2-0c67-4bbc-b0aa-703eb8c4cccf None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:54.750053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-daad73c2-0c67-4bbc-b0aa-703eb8c4cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:54.826290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 411/839] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:54.869770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bf16-a1ae-4820-bddf-a79a25c8c2d6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.870279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bf16-a1ae-4820-bddf-a79a25c8c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.870387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bf16-a1ae-4820-bddf-a79a25c8c2d6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.872171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 429/840] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:54.872905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c7ba-4b50-4e68-99bc-1b93265d0465 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.873198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c7ba-4b50-4e68-99bc-1b93265d0465 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.873477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c7ba-4b50-4e68-99bc-1b93265d0465 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.875036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 412/841] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:01:54.877253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.877540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.877817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.879979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:54.880265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:54.880537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:54.897637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:54.898936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:54.899049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:54.900812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:54.978741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 413/842] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:01:54.986091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 430/843] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:55.116734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.127541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.238508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78e60d-f1f6-4198-88c0-103a2c71deee None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.261562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.274562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.275261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.275554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.275849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.286738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:55.292410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:55.293378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:01:55.294318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:55.296374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 414/844] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:55.297407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.365527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.394029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748faf8e-5a61-4e46-9ad3-08906bd16279 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.396382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.407956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fc52-102c-4be9-ac3b-c58d84ca7212 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.435228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.435928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.436211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.436480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.446540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.447247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.447526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.447799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.448225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:01:55.448371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:55.449745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:01:55.453547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:55.454682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:01:55.455772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:55.462813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:55.463876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:01:55.464753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:55.466174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 431/845] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:55.466259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 415/846] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:55.466259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.466384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.571534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f3212-9ba6-4441-8e27-c04c6134c0b9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.582258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60880e-3186-480f-b056-4341d30023f0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.605228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.611372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.611984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.612267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.612545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.613197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:55.613498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:55.614869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:55.621670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.622287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.622571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.622847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.623547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:55.623850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:55.625334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:55.628711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 416/847] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:55.629669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.639932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 432/848] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:55.639932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.671582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.744323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986bad0-3a95-4f70-8de2-00b5b465c280 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.752271 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860e207-c60e-4f2d-9fe9-e643b88018ae None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.792727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.792975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:55.793343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.793451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:55.793625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.793721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:55.793884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.794016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:55.794510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:55.794815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:55.796220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:55.801401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 417/849] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:55.807071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:55.807334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.808717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:55.826393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:55.827800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:55.829560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:55.829560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:55.829560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:55.829560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 433/850] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:55.829560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:55.888142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.943336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:55.965431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c5153-b9b2-4d20-b0e3-45d191eb8f3b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:55.981454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f5f6-50e1-4421-9943-dd224f621c8d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.019172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.020168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.020575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.021023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.033536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.033771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.034201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.034515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.034783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.035234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.035439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:56.035749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.037100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.041995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 434/851] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:56.042789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ebf94602-9767-4b13-9ebe-02d551cc59bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:56.057354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:56.058699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:56.059850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:56.059850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:56.059850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:56.060237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 418/852] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:56.061544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37a42-fe8d-4054-adf6-9f8723a5b89f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.061826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37a42-fe8d-4054-adf6-9f8723a5b89f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.062096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b37a42-fe8d-4054-adf6-9f8723a5b89f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.063413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 419/853] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:56.066221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b37a42-fe8d-4054-adf6-9f8723a5b89f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.174773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7398d2-b76f-4027-be02-bae8bde3f104 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.195495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b37a42-fe8d-4054-adf6-9f8723a5b89f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.207232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.215628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.216230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.216512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.216787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.217435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:56.217800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.219206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21229577-ed72-437d-a1c6-039da174f730 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.233210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 435/854] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:56.234508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.234793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.235065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.242471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.248066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.248839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.249169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.249492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.250403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:56.250923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.253384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.255989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:56.257203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:56.274542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 420/855] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:56.276120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.334651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 436/856] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:56.335342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.413840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a24f1e-0172-4029-b908-a15606193b99 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.445874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821dfa-9fc9-480f-be49-e0a57e64ebfb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.457484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.458782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.459533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.460042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.469511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.471538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.479533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:56.486394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:56.487610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:01:56.488558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:56.489091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.489091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.489091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.489091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.491467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 421/857] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:56.498621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.502849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.504372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:01:56.518093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:56.519095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 19 11:01:56.520054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:56.523550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 437/858] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:56.525928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.537641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.628093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f43a3-7722-407a-9dd9-b33555367b45 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.646285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602e708-eb07-44ac-8a98-f136de0d9070 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.665844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.666776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.667058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.667359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.668088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:56.668388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.669819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.683477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.684081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.684356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.684624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.685839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:56.686153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.687621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.693686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 422/859] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:56.693686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.710792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 438/860] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:56.711651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.769781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.786677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:56.802831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d810ade-a9aa-4abe-a45e-4d51e4d18565 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.829172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7778-47f9-493e-8e68-57b12ae5c759 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:56.840568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.841188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.841795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.842072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.842730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.844239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:56.862061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 423/861] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:01:56 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:56.863480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:56.889860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:56.890525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:56.890806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:56.891076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:56.984477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:56.986394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.027809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c67b0-1070-4d5a-9c35-f665b35a1ddf None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.042864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.078272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.078887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.079186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.079458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.100390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.117051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 439/862] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:01:57.124238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.173426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.176027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.250536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda54c3-81c7-4516-b775-4bf68e96bb0a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.299186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.299186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.299186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.299186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.299909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 424/863] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:01:56 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:01:57.305351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.310228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.311836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.320710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:57.330704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:57.331919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:57.332853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:57.332853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:57.332853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:57.334691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 440/864] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:57.343187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.364047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.424669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc3799-014e-4804-b1c8-95ae619d154e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.466409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.466620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2121fa-aaf6-401a-bf57-643db6bc9093 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.467044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.467349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.467620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.478662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.480654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:01:57.496441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:57.497503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:01:57.498434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:01:57.498434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:01:57.498434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:57.498434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 425/865] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:57.503434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.505048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.505752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.506100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.506547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.507300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:57.507752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.509240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.522864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 441/866] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:57.528624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.606958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.619555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.624248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5778cb-a218-47a5-ae09-cd209468bae0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.663695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55efa-1abc-4f91-bb87-1f4960a98371 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.670922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.671567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.671845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.672163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.672797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:57.673660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.675051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.691499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 426/867] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:57.696725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.709432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.710897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.711564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.712042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.722261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.724294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:57.741068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:57.742012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:57.742923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:01:57.745240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 442/868] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:01:57.752177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.822893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac506212-9c93-473f-923e-85aa814d805f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.865670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a1284-5117-4ccb-b746-8e69f7fb3a81 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:57.872904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.873984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.874471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.874941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.886960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.888872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:57.890702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.907595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:57.908207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:57.908487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:57.908760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:57.909457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:01:57.909717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:57.910546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:01:57.911494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:57.911926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:57.911926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:57.914923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 427/869] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:57.921506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.933396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 443/870] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:57.938239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:57.949658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:58.036800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6688659-287a-4432-b1ca-74b359ab1769 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:58.058171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08784b-da3c-4007-9de7-7419eee7b317 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:58.074370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:58.075378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.075868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.076346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.077245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:58.077771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:58.079445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:58.093048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 428/871] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:58.098635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:58.099126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:58.099777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.100059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.100336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.101055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=1fa0b90d101249b0803066fd7604aa84) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:58.101364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:58.102917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a396b0c-50c3-4418-b86d-68a842217513 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:58.115562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 444/872] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:57 2022] GET /identity/v3/role_assignments?user.id=1fa0b90d101249b0803066fd7604aa84&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:58.194325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:58.219681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd396be-849b-4a84-b3f7-33e700f41211 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:58.264092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:58.264717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.264998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.265269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.266023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a0a463d7f5db49fe9de8bb390363ba5b) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:58.266379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:58.267920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035a279-46a6-4e73-a1f4-f0198d4d2fe1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:58.275287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 429/873] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:01:58 2022] GET /identity/v3/role_assignments?user.id=a0a463d7f5db49fe9de8bb390363ba5b&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:01:58.352013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864fbf-f941-4d21-89c3-537b4d9c3775 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.352309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864fbf-f941-4d21-89c3-537b4d9c3775 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.352509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a864fbf-f941-4d21-89c3-537b4d9c3775 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.354718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 445/874] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:58.360750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214ff5-8edd-4f94-836a-7c415e1ccacc None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.361040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214ff5-8edd-4f94-836a-7c415e1ccacc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.361299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07214ff5-8edd-4f94-836a-7c415e1ccacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.381299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-07214ff5-8edd-4f94-836a-7c415e1ccacc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:58.382522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-07214ff5-8edd-4f94-836a-7c415e1ccacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:58.459925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 430/875] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:58.733885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a864fbf-f941-4d21-89c3-537b4d9c3775 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:58.790389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:58.898770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a864fbf-f941-4d21-89c3-537b4d9c3775 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:58.938161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804be1-c86c-41d2-8315-159673639591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:58.939141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804be1-c86c-41d2-8315-159673639591 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:58.939652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804be1-c86c-41d2-8315-159673639591 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:58.940119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804be1-c86c-41d2-8315-159673639591 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:58.941285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804be1-c86c-41d2-8315-159673639591 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:58.942888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804be1-c86c-41d2-8315-159673639591 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:58.961659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 446/876] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:01:58 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:01:59.219936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b43c6-e72f-4c2a-a14d-f18216900ca5 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:59.220453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b43c6-e72f-4c2a-a14d-f18216900ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:59.220531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b43c6-e72f-4c2a-a14d-f18216900ca5 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:59.222064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 431/877] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:01:59.227523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:59.227813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:59.228123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:59.246776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:01:59.248004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:01:59.338545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 447/878] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:01:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:01:59.610314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b43c6-e72f-4c2a-a14d-f18216900ca5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:59.687855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:59.721784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b43c6-e72f-4c2a-a14d-f18216900ca5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:59.763010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:59.764051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:59.764532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:59.765005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:59.765792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:59.767396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:01:59.777585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:01:59.778547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:01:59.779476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:01:59.782196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 432/879] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 19 11:01:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:01:59.787848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:01:59.818782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:01:59.906326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b71bfc-4e52-4aa4-8849-a9ff6de8bd62 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:01:59.945625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:01:59.946608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:01:59.947142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:01:59.947660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:01:59.948483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:01:59.949004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:01:59.950576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:01:59.956037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 448/880] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:01:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:01:59.964204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:00.072429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e921-c9a1-400a-9f85-76597b4bf6fb None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:00.109080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:00.109998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.110487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.110943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.111779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:00.112260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:00.113801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:00.116242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:00.122317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 433/881] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:01:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:00.128343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:00.235520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:00.246131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9656cd1-51c4-44ba-b812-cdbc402d1d9d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:00.290566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:00.291585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.292076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.292554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.293452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] RBAC: Adding query filter params (interface=public, service_id=f120a12ba90a42c58e6aa67c04d23d53, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:00.293983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:00.295597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0b5a9-ea86-46bb-8e88-d183c196491d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:00.301848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 449/882] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:02:00 2022] GET /identity/v3/endpoints?service_id=f120a12ba90a42c58e6aa67c04d23d53&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:00.308295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:00.425747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f6b92-8d87-429a-891e-3348bacc073a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:00.463974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:00.464831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.465253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.465669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.466416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:00.467961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083daab-c697-42ce-aedd-14a456d7339f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:00.474274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 434/883] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:00 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:02:00.520806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7423-e935-486f-9455-266c674ffa7b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.521073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7423-e935-486f-9455-266c674ffa7b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.521352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7423-e935-486f-9455-266c674ffa7b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.523035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 450/884] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:00.532359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b1d-61d0-4ae1-95ad-d12a8e9303ed None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.532359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b1d-61d0-4ae1-95ad-d12a8e9303ed None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.532359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a64b1d-61d0-4ae1-95ad-d12a8e9303ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.550870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c2a64b1d-61d0-4ae1-95ad-d12a8e9303ed None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:00.552449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c2a64b1d-61d0-4ae1-95ad-d12a8e9303ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:00.632748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:00.644905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 435/885] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:00.739214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3feaf-1967-4fc8-854d-c4365f23eeed None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.739687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3feaf-1967-4fc8-854d-c4365f23eeed None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.740064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3feaf-1967-4fc8-854d-c4365f23eeed None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.741732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 451/886] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:00.748256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:00.748541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:00.748814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:00.767863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:00.769045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:00.846292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 436/887] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:00.923036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3feaf-1967-4fc8-854d-c4365f23eeed None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.039529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3feaf-1967-4fc8-854d-c4365f23eeed None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.076825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.077457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.077736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.078004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.090233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:01.095376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:01.096436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:01.097643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 452/888] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:01.105201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.137242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.157718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.227638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a9dfc-d57a-4059-97c5-edc7a768437d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.248914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b3f86-453f-4d86-9701-a2a7579efe77 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.256081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.267743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.268352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.268624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.268891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.269537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:01.269830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.271219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502bfb9-7de2-45f6-a6ee-e9b8d25887f8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.289503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 437/889] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:01.289503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db22e-9b35-4143-85d0-de4aa6704d17 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.289503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db22e-9b35-4143-85d0-de4aa6704d17 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.289503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8db22e-9b35-4143-85d0-de4aa6704d17 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.289503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 438/890] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:01.293440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db22e-9b35-4143-85d0-de4aa6704d17 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.299610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.300260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.300541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.300810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.301418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.303266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2c7a94f3-0dc5-4f23-8af5-8428c4383834 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:01.313626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:01.314650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:01.316118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 453/891] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:01.316918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.316918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.316918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.335020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:01.336240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:01.410467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 454/892] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:01.411454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.414273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8db22e-9b35-4143-85d0-de4aa6704d17 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.432759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.451937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.452570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.452852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.453126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.464759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.466224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:01.481887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:01.482987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:01.483949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:01.483949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:01.483949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:01.484806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 439/893] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:01.488987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.530952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.550166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cc733-a623-4cdc-a601-59cb025e817b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.595455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.596072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.596503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.596792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.597740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:01.598051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.599833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.600440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4722-af9f-43cb-8789-fea306991a9c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.611344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 455/894] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:01.612230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.641513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.642335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.642718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.643115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.643849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:01.644218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.645914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.663904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 440/895] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:01.665218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.708481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.743909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561cc2-6050-47ba-a1a9-2b25b3efb189 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.776536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:01.780857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.781477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.781580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6469e-9c88-4a7c-aed8-8d5d3b1413dc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.781759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.782035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.782664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:01.782968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.784393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.795764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 456/896] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:01.795764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.827637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.828301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.828585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.828861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:01.844333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:01.845980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:01.862904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:01.864194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:01.865392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 441/897] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:01.870427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:01.940088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81270211-3bc7-4334-8cd0-2adb17c54704 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:01.997642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:01.998724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:01.999280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:01.999760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.000993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.002958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.015857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128c15-e8cb-4fef-bb3b-efda2aa2e2e5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:02.016572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:02.017653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:02.018505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:02.021123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 457/898] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:02.027695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.040018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.056150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.057033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.057863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.058155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.058879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:02.059212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.060925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.090781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 442/899] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:02:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:02.092221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.111899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.169619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eab4c-c0b4-4a35-b24e-e456b83f66c2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.204707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3671c-5d3c-46aa-aa56-b2c501c788b2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.221542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.222523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.223112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.223656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.224736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:02.225220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.226792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.234309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 458/900] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:02.241988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.250791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.251523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.251877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.252221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.331577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.352559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.355584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.374179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b887-e072-476e-bb1f-16c09f1fef72 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.380165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.411340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.412106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.412440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.412780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.413517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:02.414281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.415358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.426128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 459/901] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:02.427302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.510976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 443/902] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:02.512837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.547009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be6f1a-13a4-4b41-a460-3ea96a1841fd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.579232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.586593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.587764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.588225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.588701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.589568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] RBAC: Adding query filter params (interface=public, service_id=9c5a446b7d3f4207a52fe21d88fab354, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:02.589872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.591344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.602323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 460/903] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/endpoints?service_id=9c5a446b7d3f4207a52fe21d88fab354&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:02.604729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.659017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212b764-c158-44a1-83df-501dc4f3a462 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.683010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.707071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.707747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.708019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.708306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.714802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc5529-36d6-49eb-9383-3535a81e4079 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.719611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.721095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8e53e4aa-3d8f-4f62-bc71-0b4d8e6d0659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:02.738229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:02.739333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:02.740222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:02.740222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:02.740222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:02.740222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 444/904] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:02.740826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65218-3431-4385-afd3-d80e9a89d069 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.740988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65218-3431-4385-afd3-d80e9a89d069 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.741265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65218-3431-4385-afd3-d80e9a89d069 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.742860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 445/905] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:02.745294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65218-3431-4385-afd3-d80e9a89d069 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:02.766596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.767128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.767437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.767711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.768308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.769700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12bf2a-947b-44af-a958-574cd63430b7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.777002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 461/906] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:02:02.788692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.789032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.789283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.816402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:02.817628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:02.883221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a65218-3431-4385-afd3-d80e9a89d069 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:02.893469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:02.916135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 462/907] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:02.923128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:02.923795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:02.924101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:02.924379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:02.925027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:02.925332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:02.926743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:02.941766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 446/908] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:02.947566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.061395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a9134-e794-4c3e-932e-df51f3b8f3e5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.098578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.099299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.099576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.099852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.107069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.108572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:03.121147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:03.122075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:03.122955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 463/909] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:03.129890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.164311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:03.199792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.241458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86067a-5ead-45b8-85bd-1dbbd516f77c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.268049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:03.286654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.287322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.287604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.287877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.288566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:03.288871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.290456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.309829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 447/910] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:03.316779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.341170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594fc2-7f60-4037-97a4-5eb8626bb5fb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.389996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.390801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.391088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.391396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.391983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.394027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:03.405323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:03.406320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 19 11:02:03.407643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:03.411320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 464/911] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Sep 19 11:02:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:03.412869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.430497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:03.446359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311410b-b48b-460d-ae4e-283dd395d72a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.490067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.490690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.490973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.491301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.492027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] RBAC: Adding query filter params (role.id=7d99ab20d1b540419f6b58c15f38bf5b, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=1fa0b90d101249b0803066fd7604aa84) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:03.492399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.494963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.507661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 448/912] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:03 2022] GET /identity/v3/role_assignments?user.id=1fa0b90d101249b0803066fd7604aa84&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=7d99ab20d1b540419f6b58c15f38bf5b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:03.534426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5fb9b-f02e-48b0-a2dc-ee8c62fe3501 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.551731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:03.577398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.577944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.578234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.578510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.579177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:03.579503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.581013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.587025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 465/913] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:03.593673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.710117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a940a1-b949-41ed-adff-6a4c8d26656b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.749808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.750806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.751324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.751806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.752655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:03.753168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.754746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce33ad-c21b-478a-8066-1e37e1315b1f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.761341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 449/914] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:03.767420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:03.885323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907230d-927b-4140-9909-f54b1ad09ffd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:03.927118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:03.927760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:03.928035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:03.928363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:03.929031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:03.930398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02971fb1-fe9e-408c-b714-a1cc75f7db15 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:03.956465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 466/915] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:04.070177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3b1-703d-4981-824e-daefcb1d5815 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:04.070526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3b1-703d-4981-824e-daefcb1d5815 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:04.070730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892de3b1-703d-4981-824e-daefcb1d5815 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:04.073289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 450/916] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:04.079070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517685e-2309-4304-909d-6c47d7eb4751 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:04.079395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517685e-2309-4304-909d-6c47d7eb4751 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:04.079693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517685e-2309-4304-909d-6c47d7eb4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:04.101601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8517685e-2309-4304-909d-6c47d7eb4751 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:04.103272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8517685e-2309-4304-909d-6c47d7eb4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:04.133996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:04.186427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 467/917] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:04.470472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de3b1-703d-4981-824e-daefcb1d5815 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:04.493567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:04.584936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892de3b1-703d-4981-824e-daefcb1d5815 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:04.622159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:04.622785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:04.623045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:04.623356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:04.624020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:04.625400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631379-6f81-4e1e-8cff-6bd514e52b12 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:04.642970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 451/918] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:02:04 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:05.136422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1610f6-e937-46ac-841c-8773ebd4d850 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.136956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1610f6-e937-46ac-841c-8773ebd4d850 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.136956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1610f6-e937-46ac-841c-8773ebd4d850 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.138651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 468/919] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:05.144192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.144480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.144754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.164582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:05.166603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:05.245654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 452/920] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:05.528891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1610f6-e937-46ac-841c-8773ebd4d850 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:05.643654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1610f6-e937-46ac-841c-8773ebd4d850 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:05.683805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:05.684463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.684746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.685020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.685611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:05.687050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3286a26e-ab64-47c7-9afb-fa99d5bbc4c9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:05.698022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:05.699141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:05.700353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 469/921] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:05.707569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:05.710671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:05.800614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a3dd7-d292-4a37-aab3-1e391712d27e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.800912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a3dd7-d292-4a37-aab3-1e391712d27e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.801101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a3dd7-d292-4a37-aab3-1e391712d27e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.802754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 470/922] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:05.808512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.808798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.809077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.820513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f3da-e643-4022-8d0b-7acaf2bdcfd1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:05.828654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:05.829879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:05.854322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:05.857963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:05.858586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:05.858865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:05.859141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:05.859789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:05.860094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:05.861471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:05.867769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 453/923] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:05.873912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:05.919518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 471/924] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:05.944778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:05.980553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb79d5-0308-4e40-98c3-b96df0761d22 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.016490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.017093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.017368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.017636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.018254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:06.018554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.019954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.025325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 454/925] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Sep 19 11:02:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:06.032490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.141996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfda21-eaa3-417e-8901-d5d8dde9b444 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.183337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.184239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.184524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.184799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.185488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.186964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98dabe-5703-4cdc-9d94-72ccd5ec5557 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.203456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.216938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 472/926] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:06.294575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5ffa-e9c1-43cc-87b4-93e98d136b3f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.294575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5ffa-e9c1-43cc-87b4-93e98d136b3f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.294575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5ffa-e9c1-43cc-87b4-93e98d136b3f None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.299216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 473/927] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:06.300664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.300956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.301244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.323923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:06.325272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:06.327392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6d355-255e-4862-ba38-3c67370f85ab None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.327858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:06.365972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:06.381237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.382146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.382580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.383031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.398053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:06.405419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:06.406625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:06.407714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:06.410058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 455/928] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:06.419261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.421361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 474/929] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:06.534831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dd9d0-1337-4a8b-b7f5-b137e22c0cd6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.573520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.574215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.574498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.574764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.575456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:06.575754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.577121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.586067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 456/930] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:06.591959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.697784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8c712-c9f2-4ade-9c24-af06d82cbc86 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.713404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.736230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.736870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.737152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.737430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.747525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:06.750605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.752426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.770097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:06.776059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:06.777060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:06.778360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:06.778360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:06.778360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:06.778360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 475/931] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:06.783305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.829842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d3708-ed07-4bb2-8772-f14b30fc7e18 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.867127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.868196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.869249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.869750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.870563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.872296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:06.882454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:06.883597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:06.885066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:06.893046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 457/932] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:06.894871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:06.903906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e021b-5bfd-42c3-a88f-135dbb68b9fe None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:06.943687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:06.944255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:06.944535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:06.944809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:06.945447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:06.945751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:06.947384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:06.965951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 476/933] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:06.966946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.007403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7065a83-5fd2-4aa9-ac2d-febd1c53d231 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.022181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.025707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.046138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.046782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.047060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.047364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.048307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:07.048307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.049638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d51abd-cc5f-4f1c-a64d-5f3c542dcb76 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.054718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 458/934] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:07.059372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122ca9-73cb-4a02-8861-3d2d5f1f3b6f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.059898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122ca9-73cb-4a02-8861-3d2d5f1f3b6f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.060351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122ca9-73cb-4a02-8861-3d2d5f1f3b6f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.062710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 459/935] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:07.064201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15122ca9-73cb-4a02-8861-3d2d5f1f3b6f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.086627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0442ea-31ee-409a-8fa3-21aa710f2a27 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.123791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.124428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.124715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.124990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.133114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.135185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-433b681b-4dec-4e9c-bead-91f8bc0c48fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:07.148261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:07.150035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 477/936] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:02:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.151444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.152453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.171932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:07.173127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:07.184199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15122ca9-73cb-4a02-8861-3d2d5f1f3b6f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.222820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.224031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.225003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.225647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.226659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:07.227337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.230063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.235819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 460/937] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:07.241161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.259723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 478/938] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:07.294210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.366040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068969b-dcb5-4598-bd30-0d3e2940eb09 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.405933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.406875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.407402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.407859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.408781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:07.409275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.410914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.435493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 461/939] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:07.437412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.483921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.539275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.549847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1bb67-8821-4584-8b2e-20aacc43874e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.596778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.598097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.598649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.599322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.614185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.615705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:07.632910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:07.633958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:07.635455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:07.635455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:07.635455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:07.639524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 479/940] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:07.640624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.654987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.660934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92516589-8e58-4529-bab2-f5f2f24aff1c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.708715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.710167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.710931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.711482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.712482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.714732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:07.726750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:07.727982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:07.728832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:07.731088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 462/941] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:07.744017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.756266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.768170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949e093-efe1-4b2a-ab1f-a63d3b64325b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.807955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.809079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.809564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.810104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.810969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:07.811541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.813340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.828424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 480/942] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:07.834317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.874052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ea1ef-95c7-474f-b0fc-e1186df84049 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.920552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.921208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.921496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.921769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:07.922401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:07.922704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:07.924915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:07.935190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 463/943] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:07.938720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:07.956574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7773160-0ef7-4ced-addf-a4619708457c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:07.980650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:07.994610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:07.995286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:07.995638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:07.995984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.003495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.005053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:08.017422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:08.018388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:08.019340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 481/944] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:08.024263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:08.044919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:08.081139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd20bb-5000-4f01-9585-854b5ad073bc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:08.120707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693597-964f-4177-8046-378b822ac6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:08.121676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693597-964f-4177-8046-378b822ac6ad None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.122221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693597-964f-4177-8046-378b822ac6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.122694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693597-964f-4177-8046-378b822ac6ad None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.123596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693597-964f-4177-8046-378b822ac6ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:08.124263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693597-964f-4177-8046-378b822ac6ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.125721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693597-964f-4177-8046-378b822ac6ad None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.136933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 464/945] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:08.137756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693597-964f-4177-8046-378b822ac6ad None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:08.160789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731139c0-f518-49da-8688-6de3395584f8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:08.199825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:08.200508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.200795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.201069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.201785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:08.202080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.203638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.222577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 482/946] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:08.223991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:08.252415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:08.266103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693597-964f-4177-8046-378b822ac6ad None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:08.307410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:08.308549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.309032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.310045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.311253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] RBAC: Adding query filter params (interface=public, service_id=0994b0a08efa48b183c805f1f67bb398, region_id=RegionOne) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:08.311783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.313371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:08.313489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.325478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 465/947] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:02:08 2022] GET /identity/v3/endpoints?service_id=0994b0a08efa48b183c805f1f67bb398&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:08.326468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:08.359188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef2e-8346-4c5d-8fdd-1f9c73cce9e5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:08.413551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:08.415541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.416275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.417276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/1fa0b90d101249b0803066fd7604aa84/roles/7d99ab20d1b540419f6b58c15f38bf5b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.421276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=1fa0b90d101249b0803066fd7604aa84, role_id=7d99ab20d1b540419f6b58c15f38bf5b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.425213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e35a3-8fdd-443c-a421-b42a15253496 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.444236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7efe4-f2ea-4a93-9d71-67bbede4d240 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:08.447791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 483/948] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:02:08 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/1fa0b90d101249b0803066fd7604aa84/roles/7d99ab20d1b540419f6b58c15f38bf5b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:02:08.494532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:08.495605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.496134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.496633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.497476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:08.500790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf2edb-1ffd-4d29-95a5-019603299c1f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:08.509806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 466/949] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:08 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:02:08.557663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb33-5eac-46a7-968e-a862c09cdd9d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.558018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb33-5eac-46a7-968e-a862c09cdd9d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.558212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22cb33-5eac-46a7-968e-a862c09cdd9d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.559978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 484/950] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:08.566096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:08.566445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:08.566651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:08.591492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:08.593243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:08.611183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:08.681426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 467/951] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:08.969160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb33-5eac-46a7-968e-a862c09cdd9d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:09.082860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22cb33-5eac-46a7-968e-a862c09cdd9d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:09.115677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:09.124655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:09.125598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:09.126081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:09.126592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:09.127485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:09.129129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:09.132031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING keystone.server.flask.common [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 19 11:02:09.152561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.sql.core [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:02:09.152561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:02:09.152561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [parameters: {'id': '5826290da539475bad661f31de687900', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:02:09.152561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5826290da539475bad661f31de687900.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5826290da539475bad661f31de687900. Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:02:09.163763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 19 11:02:09.165060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application yield resource Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise self.value Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application session.commit() Sep 19 11:02:09.167307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:02:09.168223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:02:09.169107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:02:09.169890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [parameters: {'id': '5826290da539475bad661f31de687900', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:09.170763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:09.173230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5826290da539475bad661f31de687900. Sep 19 11:02:09.176898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:09.178413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 485/952] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Sep 19 11:02:08 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:09.186779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:09.295105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e115c-7128-4cf1-8c2c-4f3b9549bad2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:09.334319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:09.335339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:09.335823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:09.336361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:09.344072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:09.345859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ace9c803-0def-4557-88a4-b35d7db58f28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:09.359011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:09.360040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:09.360988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:09.369997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:09.379356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 468/953] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:09.487904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0f8a7-356d-4431-a531-493aa2b54749 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:09.527695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:09.528660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:09.529142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:09.529616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:09.530478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:09.531007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:09.532921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa136851-222f-4cae-9898-a7c7c397a2de None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:09.554918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 486/954] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:09.598312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeacfca-c161-4904-82e4-1d65f7d04c6d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:09.598651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeacfca-c161-4904-82e4-1d65f7d04c6d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:09.598856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeacfca-c161-4904-82e4-1d65f7d04c6d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:09.600468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 469/955] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:09.608577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf760-fbbb-48df-a10d-43e1c10067a0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:09.608896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf760-fbbb-48df-a10d-43e1c10067a0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:09.609133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf760-fbbb-48df-a10d-43e1c10067a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:09.631372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-229cf760-fbbb-48df-a10d-43e1c10067a0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:09.632963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-229cf760-fbbb-48df-a10d-43e1c10067a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:09.687838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:09.720056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 487/956] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:10.017384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeacfca-c161-4904-82e4-1d65f7d04c6d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:10.030130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:10.127522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeacfca-c161-4904-82e4-1d65f7d04c6d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:10.163407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:10.164421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:10.164903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:10.166049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:10.167028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:10.168623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89ba5d-0701-46b8-bfc3-fddf5591c1d8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:10.184727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 470/957] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:02:10 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:10.932360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cb40-e4c0-4383-92f0-36b66eb960e6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:10.933419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cb40-e4c0-4383-92f0-36b66eb960e6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:10.933941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646cb40-e4c0-4383-92f0-36b66eb960e6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:10.935970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 488/958] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:10.942582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:10.943554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:10.944059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:10.964461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:10.966024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:11.037921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26a9-f939-42d7-98a0-65868c5c4566 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.038204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26a9-f939-42d7-98a0-65868c5c4566 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.038481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d26a9-f939-42d7-98a0-65868c5c4566 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.039853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 489/959] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:11.045914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.046198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.046466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.048979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:11.062161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 471/960] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:11.069155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:11.070634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:11.145493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 490/961] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:11.340192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.447849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05743e31-6917-484f-be7c-a66765931fd9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.456375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.486067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.487118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.487632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.488213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:11.506520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:11.507801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:11.508709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 472/962] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:11.516096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.575602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d26c7-b35e-4f77-bc89-ef2faca30d0f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.580812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:11.588232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:11.619144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.620449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.620797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.621146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.621815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:11.623330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:11.633303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:11.634680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:11.640830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 491/963] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:11.641654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea301c-433a-47c3-b294-1d50ce3153e1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.643400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.677155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.678784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.679329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.679810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.681488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:11.682251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:11.683819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:11.693050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 473/964] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:11.699173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.759501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908803e9-6a48-42d7-87df-df8fcf278f59 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.798512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.799582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.800121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.800621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.801464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:11.801985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:11.803840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:11.810245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 492/965] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:11.819030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.820095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103723d-0d4c-4e0b-80b5-289bbd9a1548 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.844366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:11.855913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:11.867808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.869527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.870232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.870880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.885391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:11.888179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:11.905921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:11.906964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:11.907945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:11.907945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:11.907945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:11.911979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 474/966] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:11.913363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:11.948489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511463c8-f49f-4c65-8e1c-c75b5a8254a6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:11.994028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:11.994931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:11.995410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:11.995847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:11.996641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:11.997087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:11.998634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.006441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 493/967] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:12.014240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.039118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a85f-0462-4739-b1c1-936751b42c2d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.084423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.085444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.085931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.086410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.087858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:12.089005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.090968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.110594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 475/968] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:12.112096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.128001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.131982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ba5f5-dc43-4f9c-98b9-c96423d664ea None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.149119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.171097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.171745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.172018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.172298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.172964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.174436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f226a-0ce9-4c8b-8619-b1c1d4197535 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.194808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 494/969] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:12.196092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2fc0-673c-482d-9ec9-4ffc42555ca5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.196519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2fc0-673c-482d-9ec9-4ffc42555ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.197118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2fc0-673c-482d-9ec9-4ffc42555ca5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.198301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 495/970] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:12.203931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.204222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.204505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.224527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:12.225800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:12.245554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aef4-1955-41e1-b098-ef4d1ddabbbe None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.297005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.297906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.298364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.298908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.308759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.310713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.315961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 496/971] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:12.326607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:12.327854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 19 11:02:12.328916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:12.331257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 476/972] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:02:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:12.340210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.443084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.459420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7fd7f-90ed-4ded-afc2-8b44305effae None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.496577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.497241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.497521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.497793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.498521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:12.498824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.500316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae0d5a-020f-4473-8b55-cc1f27594e00 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.520089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 497/973] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Sep 19 11:02:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:12.526356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.528805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904332ba-6a13-4c45-87fe-7c8d72760093 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.529307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904332ba-6a13-4c45-87fe-7c8d72760093 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.529758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904332ba-6a13-4c45-87fe-7c8d72760093 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.531542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 498/974] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:12.536282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.536752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.537227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.555672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:12.557214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:12.626784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.629018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 499/975] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:12.632022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.645296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02502ce-61bc-4697-ba7c-5b13b67b02c3 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.695039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.695587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.695873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.696142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.733627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.761605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25b3dc-141a-4be9-9778-3858467248c5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:12.796429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.797883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.803302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:12.804266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:12.804744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:12.805213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:12.807533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:12.809690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:12.830898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.sql.core [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:02:12.830898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:02:12.830898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [parameters: {'user_id': 'bfe2c2f6622e4b8e834685ff0a4ce1e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:02:12.830898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81549) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:02:12.842999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:02:12.843930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application yield resource Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application next(self.gen) Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.rollback() Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.force_reraise() Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise self.value Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application session.commit() Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 19 11:02:12.844919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._prepare_impl() Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.session.flush() Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._flush(objects) Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application compat.raise_( Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application flush_context.execute() Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rec.execute(self) Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 19 11:02:12.845799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 19 11:02:12.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result = self._query(query) Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application conn.query(q) Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application result.read() Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 19 11:02:12.848945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bfe2c2f6622e4b8e834685ff0a4ce1e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:12.850791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 19 11:02:12.853219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 19 11:02:12.857443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:12.858409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 500/976] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Sep 19 11:02:12 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:12.863666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.908342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:12.927840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 477/977] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:12 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:12.929442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:12.984891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a899-44bb-4c3e-9f08-fe64386d6d2d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.023602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.024592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.025269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.025731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.029734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.035085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.037258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.048387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595ecbd-03bb-4840-a6c8-b563a68927c7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:13.051395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:13.052517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 19 11:02:13.053729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:13.054283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 501/978] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:02:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:13.054720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.093426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.094060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.094342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.094617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.095223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.096604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:13.105864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:13.106917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:13.107832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 478/979] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:13.108645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.161732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.171272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecb55-c21f-4837-afff-1cd110539bf5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.211187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.211723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.212308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.212589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.223738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.225191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.229786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faa19e-0399-45e2-b35b-33adcd0e43d0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:13.240214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:13.241164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:13.242371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:13.242371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:13.242371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:13.242371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 502/980] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:13.242371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.274220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.275300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.275763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.276198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.276928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.277235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.278713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.305114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.318504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 479/981] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:13.319434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.380627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81c8e8-a9a3-49b1-ba9f-288b528a9812 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.442674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.443489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.443859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.444229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.445568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.445986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.448573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.464789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 503/982] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:13.466023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.482201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19727e-5594-480a-a288-ae9f31b8b9b1 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.494483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.534336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.535103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.535508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.535877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.537602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.538013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.539823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.557998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 480/983] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:13.563921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.597561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e03ba-cadd-4961-9411-d73dc63477a3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.622593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.648996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.650684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.651239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.651707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.652343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.652648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.654049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.659669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 504/984] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:13.667533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.693352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e5940-6701-47d7-82ce-666a5a90b4d6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.732798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.733433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.733713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.733987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.741368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.742811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:13.755145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:13.756207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:13.757267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 481/985] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:13.762666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.789217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbd2d4-d7b5-4d9a-b5a8-d848026880aa None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.793454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.828232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.828946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.829133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.829383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.830069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] RBAC: Adding query filter params (interface=public, service_id=08f2f83c5c5e4523b0cc1e21c4817c3e, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.830376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.831801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.837482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 505/986] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/endpoints?service_id=08f2f83c5c5e4523b0cc1e21c4817c3e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:13.842674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.888636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:13.888964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124c225-b4f5-4db5-9173-a863fa56e064 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.930322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.931801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.932230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.932509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.933223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:13.933642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.934993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:13.948515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 482/987] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:13.954310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:13.959900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f843c-da5e-4de6-b427-4dae3aef83ce None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:13.996656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:13.997296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:13.997556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:13.997794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:13.998403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:13.999820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21899-3c90-4671-8faf-4885c1afd4a3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:14.006499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 506/988] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:02:14.054040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:14.073729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e1a09-3cd3-49b4-9e99-9c73f6818086 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:14.112389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:14.113011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:14.113293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:14.113564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:14.114288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] RBAC: Adding query filter params (role.id=7d99ab20d1b540419f6b58c15f38bf5b, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=1fa0b90d101249b0803066fd7604aa84) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:14.114596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:14.116124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4c61f-eb4a-44f3-b797-db4bfe974998 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:14.131456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 483/989] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:13 2022] GET /identity/v3/role_assignments?user.id=1fa0b90d101249b0803066fd7604aa84&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=7d99ab20d1b540419f6b58c15f38bf5b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:14.512602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17a5d-af38-4d10-99ba-84eec85ac240 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:14.512975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17a5d-af38-4d10-99ba-84eec85ac240 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:14.513146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17a5d-af38-4d10-99ba-84eec85ac240 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:14.514623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 507/990] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:14.519928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:14.520213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:14.520483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:14.540840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:14.541941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:14.614989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 484/991] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:14.881184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17a5d-af38-4d10-99ba-84eec85ac240 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:14.996134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17a5d-af38-4d10-99ba-84eec85ac240 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:14.998595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:15.032843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:15.033472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:15.033747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:15.034015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:15.034589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:15.036010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:15.046357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:15.047538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:15.048418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:15.051563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 508/992] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:15.054048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:15.154031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:15.176108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0588d80-6684-457d-bfd7-43605aed5230 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:15.211679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:15.213033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:15.213461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:15.213876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:15.214673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:15.215124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:15.216656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:15.222280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 485/993] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:15.228470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:15.342776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba364f5-c448-4f4d-88db-cd97b8ac2852 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:15.381011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:15.381624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:15.381908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:15.382183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:15.382808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:15.383113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:15.385385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:15.390871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 509/994] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:15.396592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:15.502603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc9e6-5710-4be6-a1dc-812a82e22b0f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:15.540386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:15.540996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:15.541277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:15.541553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:15.542250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] RBAC: Adding query filter params (interface=admin, service_id=0994b0a08efa48b183c805f1f67bb398, region_id=RegionOne) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:15.542560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:15.543962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a2972-1dd0-4610-aa47-d86ee1413484 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:15.553942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 486/995] 10.222.0.20 () {56 vars in 1249 bytes} [Mon Sep 19 11:02:15 2022] GET /identity/v3/endpoints?service_id=0994b0a08efa48b183c805f1f67bb398&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:15.554839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:15.588450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:15.663559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75807f32-5a2c-438d-8dca-fe02adc7688e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:15.699681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:15.700287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:15.700567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:15.700840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:15.701441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:15.702805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a522c2-e57a-4aa9-9928-8ee15b02579d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:15.715264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 510/996] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:15 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:02:16.240479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cb5f-5cc6-4903-b50a-723c6dd2deed None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.241211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cb5f-5cc6-4903-b50a-723c6dd2deed None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.241211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3cb5f-5cc6-4903-b50a-723c6dd2deed None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.242627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 487/997] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:16.248529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453254-89ed-4508-b731-dd54a57e7023 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.249062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453254-89ed-4508-b731-dd54a57e7023 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.249062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a453254-89ed-4508-b731-dd54a57e7023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.270485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3a453254-89ed-4508-b731-dd54a57e7023 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:16.272098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3a453254-89ed-4508-b731-dd54a57e7023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:16.349287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec266a8-6d27-45b2-89e2-a893a6c0a03f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.349725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec266a8-6d27-45b2-89e2-a893a6c0a03f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.350055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec266a8-6d27-45b2-89e2-a893a6c0a03f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.352016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 511/998] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:16.352809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 488/999] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:16.359106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.359443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.359715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.379102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:16.380400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:16.406661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:16.467197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 512/1000] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:16.619515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec266a8-6d27-45b2-89e2-a893a6c0a03f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:16.632077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:16.735192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec266a8-6d27-45b2-89e2-a893a6c0a03f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:16.738479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:16.773848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:16.776368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.776735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.776937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.777534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:16.778947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:16.789762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:16.791010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:16.791945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 489/1001] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:16.797039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:16.856994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f3910-cb10-4316-9203-4b8b6679a3fe None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:16.874599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:16.898584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:16.899284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.899572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.899843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] PATH_INFO: `/v3/services/image` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.900544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:16.902092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:16.908464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bd72b-8e00-41eb-b6b8-5e28e8277f71 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:16.911618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:16.912812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:16.913683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 513/1002] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 19 11:02:16 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:16.918666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:16.943786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:16.953071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:16.953953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:16.954654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:16.954944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:16.955873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:16.956181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:16.957686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:16.963812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 490/1003] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:16.971956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:17.031292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d0233-2bd7-49a4-bab5-21cc7c469f62 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:17.068605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:17.069212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.069474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.069750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.070376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] RBAC: Adding query filter params (name=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:17.070774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:17.073591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:17.078894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 514/1004] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:17.084263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:17.085136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48226836-d426-41a9-a5b2-ba1f620043d9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:17.123621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:17.124284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.124562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.124953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.125642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:17.125875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:17.127381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:17.130151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:17.135183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 491/1005] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Sep 19 11:02:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:17.139581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:17.181505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:17.200160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7b6f7-c6b0-4202-948f-ff082d652394 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:17.238198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:17.238810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.239088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.239392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.240011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] RBAC: Adding query filter params (type=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:17.240311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:17.241693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de3c0f-9f2a-4729-b053-495d155c1b27 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:17.255201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 515/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:17.255874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2504cb-a29a-427a-aca9-e9e3276b8728 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:17.300629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:17.301256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.301538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.301810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.302489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:17.303951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeed063-6f3e-425f-b27e-d92fa98d8c94 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:17.327681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 492/1007] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:02:17.948519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c36eb-3a40-4e45-96f4-241b50ff2c6b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.948934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c36eb-3a40-4e45-96f4-241b50ff2c6b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.949114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c36eb-3a40-4e45-96f4-241b50ff2c6b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.950458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 516/1008] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:17.956106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:17.956395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:17.956674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:17.975737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:17.977114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:18.036246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:18.061416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 493/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:17 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:18.336416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c36eb-3a40-4e45-96f4-241b50ff2c6b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:18.443029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c36eb-3a40-4e45-96f4-241b50ff2c6b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:18.479261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:18.479894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:18.480346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:18.480483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:18.481090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:18.482385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:18.491432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:18.492609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 19 11:02:18.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:18.495877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 517/1010] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Sep 19 11:02:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:18.498752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:18.600653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678d34-e425-468f-aa75-86f0a164e82c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:18.634928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:18.635572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:18.635852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:18.636129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:18.636748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:18.637051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:18.638431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:18.643548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 494/1011] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:18.649315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:18.665669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:18.756089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a83f-8f1a-4147-af90-45775575a465 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:18.791222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:18.791832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:18.792108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:18.792378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:18.792996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:18.793293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:18.794681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36c9dd-be3f-43a6-94c3-43a066cb0305 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:18.800218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 518/1012] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Sep 19 11:02:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:18.805925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:18.855286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:18.919326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f2e0-d12e-47a8-a067-dec8a405beca None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:18.955273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:18.955887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:18.956167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:18.956439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:18.957138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:18.958514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabab25-975e-42b0-859f-1d11cf731b4c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:18.983188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 495/1013] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:19.474946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20688ff-a699-4714-b3e7-5ba2ec5e111b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:19.475516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20688ff-a699-4714-b3e7-5ba2ec5e111b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:19.475516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20688ff-a699-4714-b3e7-5ba2ec5e111b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:19.477008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 519/1014] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:19.482964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca49de-4d28-43fd-8e1d-44711cc6b627 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:19.483282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca49de-4d28-43fd-8e1d-44711cc6b627 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:19.483564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca49de-4d28-43fd-8e1d-44711cc6b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:19.502606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-9eca49de-4d28-43fd-8e1d-44711cc6b627 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:19.503839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9eca49de-4d28-43fd-8e1d-44711cc6b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:19.591258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 496/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:19.641838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23af27-8c2a-476f-bfd8-c4aea8ec8c94 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:19.642171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23af27-8c2a-476f-bfd8-c4aea8ec8c94 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:19.642407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23af27-8c2a-476f-bfd8-c4aea8ec8c94 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:19.643875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 520/1016] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:19.648884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:19.649719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:19.650122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:19.669164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:19.670346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:19.698453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:19.745470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 497/1017] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:19.857172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23af27-8c2a-476f-bfd8-c4aea8ec8c94 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:19.947233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:19.972471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23af27-8c2a-476f-bfd8-c4aea8ec8c94 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:20.010972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:20.011632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:20.011926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:20.012206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:20.012861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:20.014321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:20.039213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 521/1018] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:02:19 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:20.051693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:20.206130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf61ab5-48f0-459b-bfb3-1111afcdcd91 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:20.260651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:20.262089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:20.262089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:20.262281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:20.282330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:20.287368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:20.288409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:20.289452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 498/1019] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:20.296079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:20.433847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4c67-283e-49ee-9c65-77692d7a1bae None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:20.476668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:20.478091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:20.478637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:20.479103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:20.480205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:20.480699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:20.483146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:20.485849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:20.497312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 522/1020] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:20.504115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:20.530410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:20.623261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8f280-3f3c-417e-93f7-6a3ed4f5ffc4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:20.663489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:20.664101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:20.664421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:20.664708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:20.680988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:20.683598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:20.702038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:20.703130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:20.704428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:20.704428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:20.704428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:20.704428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 499/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:20.710583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:20.832159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eb945-4749-48ba-ac0d-baa8dd724f34 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:20.875194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:20.875818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:20.876098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:20.876373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:20.877012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:20.877313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:20.878686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:20.896915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 523/1022] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:20.898351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:20.994826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.031131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79409a-0ea8-46a0-bd0f-90c348baed39 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.075406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.076034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.076308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.076582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.084345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.085704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-34d0c226-bfcf-4ce1-9a52-1d94d4397ffa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:21.097924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:21.098937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:21.099981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 500/1023] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:02:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:21.107120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.173652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.218398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92927f-1795-4f5b-817b-15ef95e46836 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.236403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ac76-cdfa-4d56-90ed-7d397f9a8d01 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.237058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ac76-cdfa-4d56-90ed-7d397f9a8d01 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.237340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ac76-cdfa-4d56-90ed-7d397f9a8d01 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.238809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 501/1024] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:21.244572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.244857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.245126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.259904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.260517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.260799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.261077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.261803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:21.262096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.263579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.265504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:21.266720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:21.287323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 524/1025] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:21.288758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.347620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 502/1026] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:21.396739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585efaf-4069-49ae-a69d-eac2431fb64e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.413735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.434320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.434934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.435244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.435520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.507337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.508862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.615280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 525/1027] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:02:21.617509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.626647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.645118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.680125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.724362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f77331-967a-4eaa-8be9-636d86d1a9cc None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.738351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0857f7-1a96-4200-9809-d3674c3ff6b8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.763261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.763895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.764209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.764427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.776131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.776408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.776989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.777269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.777542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.777646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.778644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.780113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.781696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 526/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:21.787333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:21.795418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:21.796480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:21.802090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:21.802090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:21.802090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:21.802090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 503/1029] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:21.802090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.902408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.922094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11a3b2-0756-4416-967e-497804ed8979 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.923990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdd9e6-93ba-4668-ae24-cb135af4ed4f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:21.939790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:21.959497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.960106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.960391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.960659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.961377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.963380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.965366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:21.965979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:21.966259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:21.966533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:21.967225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:21.967531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:21.969445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:21.989280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 504/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:21.990817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:21.997389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 527/1031] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:02:21 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:02:22.110365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe94c98-669b-4980-8ac4-7684a458ecb4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:22.149600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:22.150435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.150717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.150993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.158923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:22.160351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-b20d2380-3112-46b3-a62f-fead3cdae0e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:22.173117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:22.174114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:22.175035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 505/1032] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:22.182780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:22.299928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26ffdc-1b1e-4053-bf9f-f34dbc4caa59 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:22.302330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65b54-64c6-4506-bd43-2a569f3a970a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.302616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65b54-64c6-4506-bd43-2a569f3a970a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.302894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65b54-64c6-4506-bd43-2a569f3a970a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.304274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 506/1033] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:22.309874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.310152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.310434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.329317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:22.330522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:22.339272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:22.339884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.340157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.340436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.341130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:22.341430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:22.342874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:22.345547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:22.360345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:22.362571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 528/1034] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:22.364825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:22.407414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 507/1035] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:22.473501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b962a2f-29e7-4473-b9eb-f151fa2985bd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:22.508954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:22.509917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.509917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.510066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.510795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] RBAC: Adding query filter params (role.id=7d99ab20d1b540419f6b58c15f38bf5b, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:22.511108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:22.512594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:22.527420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 529/1036] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:22 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=7d99ab20d1b540419f6b58c15f38bf5b => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:22.679864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:22.784612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cdec6-2469-4849-87e9-65f8f8e99674 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:22.822333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:22.823389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.823880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.824363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.825185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:22.826909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:22.836571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:22.837693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:22.838563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:22.843342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 508/1037] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 19 11:02:22 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:22.844680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:22.913197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:22.960349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216c209-68ae-4b4a-8f18-723aeed697f4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:22.996367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:22.996977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:22.997349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:22.997623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:22.998237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] RBAC: Adding query filter params (name=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:22.998533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:22.999986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:23.005201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 530/1038] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:23.011094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:23.041285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:23.118200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9c101-1c17-40ab-8894-2ed4c3fcdff4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:23.152844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:23.153447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:23.153720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:23.153986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:23.154598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:23.154893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:23.156283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:23.161449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 509/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:23.167565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:23.272894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b2907-641c-41e9-ad38-ff2b24470e20 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:23.303851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:23.316842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:23.317458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:23.317741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:23.318017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:23.318717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] RBAC: Adding query filter params (interface=public, service_id=1a32ac9c7abe49319b4382b9bd2fa460, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:23.319094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:23.320449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204549e-5c90-4c1e-87a7-dfc4e12a7ea9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:23.331420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 531/1040] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:02:23 2022] GET /identity/v3/endpoints?service_id=1a32ac9c7abe49319b4382b9bd2fa460&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:23.332372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:23.426821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:23.438087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03f8f2-acf5-46da-8679-51728c746ec2 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:23.473588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:23.474197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:23.474479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:23.474754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:23.475376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:23.476733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619c118-9635-430d-a201-86c2c7f71b41 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:23.483771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 510/1041] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:02:23 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:02:24.221331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428022a-7a8f-44c5-86ed-132aa4f1027a None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.221889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428022a-7a8f-44c5-86ed-132aa4f1027a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.221970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428022a-7a8f-44c5-86ed-132aa4f1027a None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.223434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 532/1042] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:24.229101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952868-7a33-433d-bb2e-8ed12927953e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.229546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952868-7a33-433d-bb2e-8ed12927953e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.229625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef952868-7a33-433d-bb2e-8ed12927953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.249206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ef952868-7a33-433d-bb2e-8ed12927953e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:24.250399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ef952868-7a33-433d-bb2e-8ed12927953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:24.331980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 511/1043] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:24.608252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428022a-7a8f-44c5-86ed-132aa4f1027a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:24.689287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378879-2fed-4ff2-95b0-54a767c2c054 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.689651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378879-2fed-4ff2-95b0-54a767c2c054 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.689849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a378879-2fed-4ff2-95b0-54a767c2c054 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.691474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 512/1044] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:24.697057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.697413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.697783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.716651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:24.717857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:24.718693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428022a-7a8f-44c5-86ed-132aa4f1027a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:24.756753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:24.759211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.759710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.760177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.761530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:24.763695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:24.765550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 533/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:24.770947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:24.803510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 513/1046] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:24.831749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:24.878936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337f47-b747-4c28-b8e6-465966cf9258 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:24.914355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:24.915135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:24.915459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:24.915736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:24.916395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:24.917849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:24.941526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 534/1047] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:02:24 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:02:25.070411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:25.088430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:25.186033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a3f2-a8f7-4145-a537-3c60bbd2f478 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:25.223312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:25.223949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.224223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.224492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.235697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:25.240527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:25.241469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:25.243958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 514/1048] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:25.248191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:25.357944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a0359-a4d1-4359-a0e2-9e60d9801ba9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:25.371736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:25.395907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:25.396518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.396795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.397105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.397759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:25.398056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:25.400060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:25.408731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 535/1049] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:25.414227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:25.491843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:25.521578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456acde6-22ad-4f0c-8703-f1c378d8aa45 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:25.562533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:25.563184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.563466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.563732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.574866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:25.576054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-33456b6f-e4a6-4585-8a0e-6c2d97051803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:25.591688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:25.593164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:25.594138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:25.594138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:25.594138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:25.594913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 515/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:25.599066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:25.709214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964dcbf-ada8-4b3e-b54a-5c39178b6e0d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:25.724582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aee6b-083d-4faa-b777-acc7b4beb37a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.724928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aee6b-083d-4faa-b777-acc7b4beb37a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.725142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aee6b-083d-4faa-b777-acc7b4beb37a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.726625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 516/1051] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:25.732470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.732755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.733040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.747499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:25.748362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.748785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.749244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.750013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:25.750454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:25.752033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:25.752149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:25.753317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:25.769597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 536/1052] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:25.770727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:25.807603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:25.836884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 517/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:25.878827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2138c-717c-4abc-bf8f-b22fa193a527 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:25.917107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:25.918021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:25.918463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:25.918880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:25.926952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:25.928633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:25.941737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:25.942870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:25.944053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:25.950992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 537/1054] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:25.951873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.010358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.057603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7f298-0045-4b70-a2ce-939331018c82 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.093214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.094125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.094594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.095042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.095970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:26.096447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.098062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.107081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.117927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 518/1055] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:02:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:26.123448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.214660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.222107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388f39-80d4-4355-928a-0f361e3cf3bc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.238240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bc59-3749-46ce-8477-0e2718b6907a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.254754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.258000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.259707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.259707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.260549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] PATH_INFO: `/v3/services/image` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.261117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.262522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:26.272635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:26.273753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:26.276988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 538/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:26.280225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.289885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.290868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.291250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.291609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.302624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.304190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:26.321466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:26.323717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:26.326046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:26.326046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:26.326046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:26.327376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 519/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:26.328906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.399808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d9670-57e4-4477-982a-09c519d60f0c None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.436185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a8cc4-248a-4bf1-b5ba-2e1e7daca67b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.437136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.437742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.438018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.438295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.439654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] RBAC: Adding query filter params (name=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:26.439654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.440911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.447133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 539/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:26.452702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.477566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.477926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.478620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.478993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.479438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.480150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:26.480604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.481884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.496755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 520/1059] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:26.502363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.531824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.573255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58714210-1102-42c3-b2db-d9e9aecf449d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.610079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.610830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.610969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce9bae-d685-46da-bd31-65304fd27b48 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.611340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.611703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.612559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] RBAC: Adding query filter params (type=image) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:26.612959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.614493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.625496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 540/1060] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:26.626376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.652746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.653483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.653845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.654123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.661185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.662640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:26.674822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:26.676103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:26.677206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:26.681459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 521/1061] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:26.682738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.722286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.740588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3d26-d092-44e7-9fe7-83ec1bb42467 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.776246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:26.778595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.779322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.779687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.780357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.781120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.782636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.793784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9a3-da9a-4929-ab43-b29a4575660c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:26.815184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 541/1062] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:02:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:02:26.842800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:26.843447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:26.843718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:26.843980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:26.844670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:26.844967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:26.846450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289bdac-6a78-44a1-82cb-76a556460596 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:26.865498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 522/1063] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:26.878123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:26.998323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb5e8-fe5a-4bec-870b-02e87778d535 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:27.035263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:27.035849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:27.036122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:27.036389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/7d99ab20d1b540419f6b58c15f38bf5b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:27.038475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=a8f507682b7f425ba842a46ad98d9dae, role_id=7d99ab20d1b540419f6b58c15f38bf5b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:27.042079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d520c6-e521-4f56-a0fc-77e67a051fe0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:27.057022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 542/1064] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:02:26 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/a8f507682b7f425ba842a46ad98d9dae/roles/7d99ab20d1b540419f6b58c15f38bf5b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:02:27.202047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dcc97-e169-409c-ac0d-9c9daf751104 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:27.202327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dcc97-e169-409c-ac0d-9c9daf751104 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:27.202608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dcc97-e169-409c-ac0d-9c9daf751104 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:27.203997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 523/1065] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:27.209881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:27.210167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:27.210444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:27.217765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:27.233821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:27.235626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:27.309049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 543/1066] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:27.579470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dcc97-e169-409c-ac0d-9c9daf751104 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:27.688835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dcc97-e169-409c-ac0d-9c9daf751104 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:27.727803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:27.728414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:27.728773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:27.729062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:27.743339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:27.748725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:27.749796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:27.750657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:27.758443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 524/1067] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:27.758642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:27.883029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6501-a0e6-47e9-8bad-6de0a43cb8c4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:27.917619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:27.924807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:27.925427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:27.925706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:27.925980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:27.926650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:27.926955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:27.928389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:27.942734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 544/1068] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:27.944303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:27.947657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:28.051399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff18e1-14bf-4c8c-ae03-85684bcb3cbe None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:28.086899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:28.087599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:28.087888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:28.088163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] PATH_INFO: `/v3/users/98c05c17c2e546abb490f994ed74a16c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:28.103582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] RBAC: Authorizing `identity:get_user(user_id=98c05c17c2e546abb490f994ed74a16c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:28.105041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:28.106915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 525/1069] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:27 2022] GET /identity/v3/users/98c05c17c2e546abb490f994ed74a16c => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:28.112482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:28.220693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df7e61-f4b0-462d-97a5-681ee6cd41dc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:28.255872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:28.256483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:28.256764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:28.257040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:28.330312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:28.339555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:28.341037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:28.444865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 545/1070] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:28.450642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:28.511455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:28.554432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2a212-a70b-402e-952b-3047af7f7d1c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:28.590166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:28.590826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:28.591065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:28.591405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:28.592499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:28.593934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795fd63-a140-456a-972c-6499de063bdb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:28.600599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 526/1071] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:28 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:28.602719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:28.698006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:28.705931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457b9d-ad6b-417c-8f2c-86dd63e31be2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:28.741521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:28.742123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:28.742403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:28.742715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:28.743501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=f8b7d938013e44b3b877d8c7aead34fe, user.id=98c05c17c2e546abb490f994ed74a16c) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:28.743809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:28.745256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d263a-ceef-4d98-956f-12cb4aff853b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:28.759247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 546/1072] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:28 2022] GET /identity/v3/role_assignments?user.id=98c05c17c2e546abb490f994ed74a16c&scope.project.id=f8b7d938013e44b3b877d8c7aead34fe&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:29.051836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d98b-44fd-4503-a2f4-5f213f4a535f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.052214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d98b-44fd-4503-a2f4-5f213f4a535f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.052411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922d98b-44fd-4503-a2f4-5f213f4a535f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.053888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 527/1073] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:29.059138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216247-1219-4206-9ea2-e16c73e5ebbc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.059465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216247-1219-4206-9ea2-e16c73e5ebbc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.059744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df216247-1219-4206-9ea2-e16c73e5ebbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.078839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-df216247-1219-4206-9ea2-e16c73e5ebbc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:29.080052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-df216247-1219-4206-9ea2-e16c73e5ebbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:29.152057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 547/1074] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:29.278490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd679-e633-4f7b-a279-7f0c6cb3c2ba None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.278490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd679-e633-4f7b-a279-7f0c6cb3c2ba None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.278490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfd679-e633-4f7b-a279-7f0c6cb3c2ba None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.279185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 528/1075] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:29.284585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.286154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.286154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.303658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:29.304779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:29.374101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 548/1076] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:29.426818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd679-e633-4f7b-a279-7f0c6cb3c2ba None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:29.534231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfd679-e633-4f7b-a279-7f0c6cb3c2ba None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:29.561994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:29.577978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:29.578595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.578867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.579136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.643592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:29.650854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:29.652874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:29.661801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:29.753494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16889b7f-f934-462c-bbb7-6f9dfd3bd6b6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:29.760556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 529/1077] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:29.766386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:29.792215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:29.792842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.793119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.793389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.795073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:29.804438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:29.810373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:29.811506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:29.812566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 549/1078] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:29.817755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:29.880266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04681-a011-47ce-88ed-104f19c86a4a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:29.900822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:29.921323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:29.922232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.922653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.923062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.926560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030938c-2ddf-4754-b82e-9040c3e28692 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:29.936195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:29.937661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:29.953934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:29.955349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:29.956262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:29.956262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:29.956262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:29.956262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 530/1079] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:29.962495 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:29.970491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:29.971109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:29.971434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:29.971830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:29.972536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:29.972842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:29.974354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:29.987978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 550/1080] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:29.991005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:30.056963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:30.079827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23a90-9abd-45e2-980e-1bb373adbc4d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.102417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0019-2ace-4c2a-a587-480eab7e4f76 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.119077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.119830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.120111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.120537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.121129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:30.121431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.122821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.136701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 531/1081] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:30.138699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.139597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.140097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.140585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.152172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:30.154938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.156666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:30.174287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:30.180743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:30.181809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:30.181809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:30.181809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:30.181809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 551/1082] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:30.182049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:30.302752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26dad0-fc40-45b2-9c29-09d298b861bd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.343090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.343655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.343939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.344218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.344857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:30.345166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.346547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.355995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:30.360036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 532/1083] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:30.366160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:30.477467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6b23f-94de-4857-9917-4d7029a8b709 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.513227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.514025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.514302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.514571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.524056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.525657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:02:30.540750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:30.542106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 19 11:02:30.543323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:30.547324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 552/1084] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Sep 19 11:02:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:30.548519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:30.647901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005c279-85a8-4b35-8232-ffdc5e6cc120 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.681511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.682139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.682385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.682659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.683414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:30.683721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.685155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3712ec9-33c3-455b-8ab0-95e02c5a61ca None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.703373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 533/1085] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Sep 19 11:02:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:30.709179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:30.763054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:30.816266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2cda5-863a-43de-9efc-3c650d632571 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:30.857649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:30.858265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.858543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.858980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.911828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1a5b-8866-4aa7-a790-b017786a63da None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.912008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1a5b-8866-4aa7-a790-b017786a63da None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.912274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a1a5b-8866-4aa7-a790-b017786a63da None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.913653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 534/1086] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:30.920117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:30.920395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:30.920673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:30.929344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:30.931268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:30.938827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:30.940064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:30.985664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:30.996110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.010896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 535/1087] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:02:31.034532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 553/1088] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:02:31.040491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.138142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3d83a-333d-4444-ae2a-c66756901c94 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.171014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.171592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.171873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.172148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.182652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.184233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:02:31.200508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:31.201526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:02:31.207286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:02:31.207286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:02:31.207286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:31.207286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 536/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:31.207560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.280578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.310873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f8baf-15cc-44ca-88ea-a5cef906a6e7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.326066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.347100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.347733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.348012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.348288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.348980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:31.349279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.350692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.362839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 554/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:31.368933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.384066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.385549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6c472-baaa-4359-b05c-c01486a48d2e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.420901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.421592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.421822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.422093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.432893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:31.437729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:31.438783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:31.440096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 537/1091] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:31.445060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.473441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b93518-4f31-473e-86cb-d17a335823f1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.507071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.507743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.508533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.508915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.515789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.517248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:02:31.528786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:31.529778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:02:31.530687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 555/1092] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:02:31.535858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.545072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.548635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a64d1-0989-4d5d-bc6f-8f434c821702 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.585801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.587259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.587540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.587846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.588933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:31.589453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.590835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.599576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 538/1093] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:31.606156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.609521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.639829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06229dd9-ee29-46dc-abfd-6d12d9f34827 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.674024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.674535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.674810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.675083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.675806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:31.676107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.677537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.689726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 556/1094] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:31.696122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.708360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edd502-2dba-4850-bdd3-f6422258d730 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.743759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.744398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.744676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.744946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] PATH_INFO: `/v3/users/98c05c17c2e546abb490f994ed74a16c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.746075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] RBAC: Authorizing `identity:get_user(user_id=98c05c17c2e546abb490f994ed74a16c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.747535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.749109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 539/1095] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/users/98c05c17c2e546abb490f994ed74a16c => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:31.754765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:31.786183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.797118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0d18e-892c-4854-b49e-7b1fd6282b20 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.827195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:31.833469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.834096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.834373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.834641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.835386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] RBAC: Adding query filter params (role.id=7d99ab20d1b540419f6b58c15f38bf5b, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=a8f507682b7f425ba842a46ad98d9dae) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:31.835691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.837242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.843299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 557/1096] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/role_assignments?user.id=a8f507682b7f425ba842a46ad98d9dae&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=7d99ab20d1b540419f6b58c15f38bf5b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:31.862150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622133e-d24c-4439-81ef-3512932a9f1a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:31.909774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:31.910427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:31.910699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:31.910974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:31.912240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:31.913686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9422b-c5de-4e58-ad76-ca6ff1e837aa None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:31.915594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 540/1097] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:31 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:31.922111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:32.032946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b68de3-bdab-49f1-a27a-4b7bad293e36 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:32.068827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:32.069488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:32.069765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:32.070036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe/users/98c05c17c2e546abb490f994ed74a16c/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:32.072339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b7d938013e44b3b877d8c7aead34fe, user_id=98c05c17c2e546abb490f994ed74a16c, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:32.073776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358e845-801b-4ae9-a49d-5c0bee4fad6b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:32.087726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 558/1098] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:02:31 2022] PUT /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe/users/98c05c17c2e546abb490f994ed74a16c/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:02:34.258968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f602-9849-4c5c-9d2b-46ba27dd7e67 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:34.259556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f602-9849-4c5c-9d2b-46ba27dd7e67 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:34.259660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425f602-9849-4c5c-9d2b-46ba27dd7e67 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:34.260913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 541/1099] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:34.266244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:34.266687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:34.266805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:34.285945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:34.287173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:34.339882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:34.357024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 559/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:34.627816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f602-9849-4c5c-9d2b-46ba27dd7e67 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:34.724890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:34.730317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425f602-9849-4c5c-9d2b-46ba27dd7e67 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:34.764987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:34.765619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:34.765897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:34.766167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:34.777328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:34.783259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:34.784362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:34.785418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 542/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:34.791680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:34.891623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865c4f8-2801-4c39-ba6c-c3d7c61197cf None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:34.926241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:34.926843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:34.927114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:34.927416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:34.928076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:34.928374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:34.930304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:34.939828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 560/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:34.946858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:35.047721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0564f8-882f-488e-a30d-f5e27f6a66fe None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:35.082301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:35.082929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:35.083236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:35.083511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] PATH_INFO: `/v3/users/98c05c17c2e546abb490f994ed74a16c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:35.084625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] RBAC: Authorizing `identity:get_user(user_id=98c05c17c2e546abb490f994ed74a16c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:35.086627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:35.088348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 543/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:34 2022] GET /identity/v3/users/98c05c17c2e546abb490f994ed74a16c => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:35.094253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:35.144315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:35.200198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb19a39-b15b-4fcc-807a-450fa1a7a9ce None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:35.235785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:35.236391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:35.236672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:35.236946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:35.305856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:35.307351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:35.354976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:35.407442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 561/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:35.413389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:35.441964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:35.515882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfa43b-46bd-4cd7-ac7b-9fdc9acc4331 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:35.549403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:35.550022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:35.550299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:35.550571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:35.551697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:35.553127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bbd25-ca2d-427e-b91f-64adc6faa30b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:35.555282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 544/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:35 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:35.561818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:35.662944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb031f-bfb9-403c-9df4-79e511ca0dd8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:35.698210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:35.698814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:35.699095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:35.699416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:35.700136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=f8b7d938013e44b3b877d8c7aead34fe, user.id=98c05c17c2e546abb490f994ed74a16c) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:35.700442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:35.701882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a6f90-fa36-4d09-9f46-a62335537dfa None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:35.707605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 562/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:35 2022] GET /identity/v3/role_assignments?user.id=98c05c17c2e546abb490f994ed74a16c&scope.project.id=f8b7d938013e44b3b877d8c7aead34fe&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:37.913110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed734e7-9c9c-4d9d-b2e4-5fc5b46c117d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:37.913654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed734e7-9c9c-4d9d-b2e4-5fc5b46c117d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:37.913654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed734e7-9c9c-4d9d-b2e4-5fc5b46c117d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:37.915374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 545/1107] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:37.920902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:37.921350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:37.921459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:37.939936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:37.941388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:37.949428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:38.009880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 563/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:38.284462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed734e7-9c9c-4d9d-b2e4-5fc5b46c117d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:38.379288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:38.387379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed734e7-9c9c-4d9d-b2e4-5fc5b46c117d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:38.421104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:38.421729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:38.422008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:38.422280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:38.423618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:38.425440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d303-779b-4a49-9460-e6678bdfeef5 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:38.427014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 546/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:38.433288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:38.531453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5f5b6-22a7-46a8-b9ae-6d2d1f870370 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:38.565182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:38.565969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:38.566245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:38.566516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:38.567148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:38.568617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d9a413-3613-4d11-8243-a8fb76ab4753 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:38.584893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:38.592534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 564/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:02:38 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:40.817751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeb32f-4698-4b70-b8fd-27f87f6be18d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:40.818285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeb32f-4698-4b70-b8fd-27f87f6be18d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:40.818285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeb32f-4698-4b70-b8fd-27f87f6be18d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:40.819846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 547/1111] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:40.825584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:40.826039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:40.826133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:40.845643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:40.846844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:40.912374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 565/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:41.184904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeb32f-4698-4b70-b8fd-27f87f6be18d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:41.288207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeb32f-4698-4b70-b8fd-27f87f6be18d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:41.322266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:41.322891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:41.323198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:41.323474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] PATH_INFO: `/v3/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:41.324867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] RBAC: Authorizing `identity:get_role(role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:41.326235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:41.327592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 548/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:41 2022] GET /identity/v3/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:41.333927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:41.431090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296121a-c6ca-48a5-9669-c00d15a8f9f6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:41.456912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:41.465462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:41.466088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:41.466369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:41.466644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] PATH_INFO: `/v3/users/4bcbad346e8940a58ba62878dab8d683` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:41.480004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] RBAC: Authorizing `identity:get_user(user_id=4bcbad346e8940a58ba62878dab8d683)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:41.481448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:41.483052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 566/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:41 2022] GET /identity/v3/users/4bcbad346e8940a58ba62878dab8d683 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:41.488942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:41.519873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:41.589298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e80d5-e90c-458f-97ec-c43b50db936c None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:41.622118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:41.622726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:41.623004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:41.623348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:41.689441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:41.691198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:41.720406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:41.789585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 549/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:41.795636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:41.898504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a86d9c-b9a6-4a01-bb58-e1ed2aa3c827 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:41.934674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:41.935342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:41.935626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:41.935903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:41.937018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:41.938472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438294f7-0eec-48dc-9697-a5536308f32c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:41.940132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 567/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:41 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:41.946719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:42.043564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7c5e-b024-4514-96cb-2167f5f7b7dc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:42.071999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:42.078104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:42.078701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:42.078980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:42.079291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:42.080003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=f8b7d938013e44b3b877d8c7aead34fe, user.id=4bcbad346e8940a58ba62878dab8d683) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:42.080311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:42.081736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a796-594f-41aa-a8f6-5b9c6ab7326b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:42.087554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 550/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:41 2022] GET /identity/v3/role_assignments?user.id=4bcbad346e8940a58ba62878dab8d683&scope.project.id=f8b7d938013e44b3b877d8c7aead34fe&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:44.205755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202274-897f-4490-91f6-8493fb72a7a0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:44.206288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202274-897f-4490-91f6-8493fb72a7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:44.206383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b202274-897f-4490-91f6-8493fb72a7a0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:44.207782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 568/1118] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:44.212980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:44.213399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:44.213520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:44.231803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:44.232983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:44.298744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 551/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:44.565902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b202274-897f-4490-91f6-8493fb72a7a0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:44.621991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:44.666886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b202274-897f-4490-91f6-8493fb72a7a0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:44.700868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:44.701491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:44.701772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:44.702042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] PATH_INFO: `/v3/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:44.703450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] RBAC: Authorizing `identity:get_role(role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:44.704827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:44.706141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 569/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:44 2022] GET /identity/v3/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:44.712812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:44.807866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d68b6-3e2e-480a-8463-588e1ad5bd82 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:44.831783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:44.843935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:44.844567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:44.844847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:44.845122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] PATH_INFO: `/v3/users/4bcbad346e8940a58ba62878dab8d683` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:44.846239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] RBAC: Authorizing `identity:get_user(user_id=4bcbad346e8940a58ba62878dab8d683)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:44.847720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:44.849304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 552/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:44 2022] GET /identity/v3/users/4bcbad346e8940a58ba62878dab8d683 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:44.855580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:44.956651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c3f41-c2e2-4a59-bf39-823588dae72f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:44.978820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:44.990335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:44.990953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:44.991261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:44.991532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:44.992818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:44.994246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c2675-af2c-441a-b35d-98a1e0e8b81f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:44.995910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 570/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:44 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:45.001985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:45.101583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7bc5f-f3b9-4bd4-86f8-2af7121f3f9d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:45.136425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:45.137072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:45.137348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:45.137619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe/users/4bcbad346e8940a58ba62878dab8d683/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:45.139754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=f8b7d938013e44b3b877d8c7aead34fe, user_id=4bcbad346e8940a58ba62878dab8d683, role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:45.141189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c7af4-153a-40f4-b94b-110b0ed37b6f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:45.154067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 553/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:02:45 2022] PUT /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe/users/4bcbad346e8940a58ba62878dab8d683/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:02:47.303058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334486-71ff-4201-b15c-ed78a9c04335 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:47.303540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334486-71ff-4201-b15c-ed78a9c04335 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:47.303626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01334486-71ff-4201-b15c-ed78a9c04335 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:47.305933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 571/1124] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:47.311421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:47.311859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:47.311951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:47.330320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:47.331548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:47.378747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:47.399531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 554/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:47.675916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01334486-71ff-4201-b15c-ed78a9c04335 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:47.780228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01334486-71ff-4201-b15c-ed78a9c04335 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:47.814509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:47.815139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:47.815874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:47.815981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] PATH_INFO: `/v3/roles/bf53d523b1244887a53cd05c7bdcd33a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:47.817370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] RBAC: Authorizing `identity:get_role(role_id=bf53d523b1244887a53cd05c7bdcd33a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:47.818755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:47.820194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 572/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:47 2022] GET /identity/v3/roles/bf53d523b1244887a53cd05c7bdcd33a => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:47.826269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:47.935390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35770dcb-d094-402e-863e-4db19a3424ef None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:47.969494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:47.970115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:47.970397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:47.970670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] PATH_INFO: `/v3/users/4bcbad346e8940a58ba62878dab8d683` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:47.971782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] RBAC: Authorizing `identity:get_user(user_id=4bcbad346e8940a58ba62878dab8d683)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:47.973218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:47.974782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 555/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:47 2022] GET /identity/v3/users/4bcbad346e8940a58ba62878dab8d683 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:02:47.981306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:48.041033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:48.083516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cba6a-f0db-479e-8d94-eead92819f51 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:48.117697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:48.118291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:48.118578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:48.118852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:48.185868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:48.187287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:48.243593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:48.285482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 573/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:02:48.292689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:48.342268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:48.392126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126da654-d335-401b-93eb-7c2b6ea9e822 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:48.425260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:48.425878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:48.426149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:48.426416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] PATH_INFO: `/v3/projects/f8b7d938013e44b3b877d8c7aead34fe` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:48.427555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] RBAC: Authorizing `identity:get_project(project_id=f8b7d938013e44b3b877d8c7aead34fe)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:48.428982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57a407-fc95-4f24-bf75-ed04edba4516 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:48.431492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 556/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:48 2022] GET /identity/v3/projects/f8b7d938013e44b3b877d8c7aead34fe => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:48.437856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:48.535279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806e29-8c29-4a88-b2f4-4007244b4ca8 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:48.569937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:48.570607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:48.570888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:48.571178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:48.571897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] RBAC: Adding query filter params (role.id=bf53d523b1244887a53cd05c7bdcd33a, scope.project.id=f8b7d938013e44b3b877d8c7aead34fe, user.id=4bcbad346e8940a58ba62878dab8d683) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:48.572204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:48.573646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d975a69-a872-489a-a2d7-e37f316e67a9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:48.579610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 574/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:48 2022] GET /identity/v3/role_assignments?user.id=4bcbad346e8940a58ba62878dab8d683&scope.project.id=f8b7d938013e44b3b877d8c7aead34fe&role.id=bf53d523b1244887a53cd05c7bdcd33a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:50.756202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c890f-f76b-4193-a765-5aa1e488ecf0 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:50.756814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c890f-f76b-4193-a765-5aa1e488ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:50.756814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c890f-f76b-4193-a765-5aa1e488ecf0 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:50.759119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 557/1131] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:02:50.764543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:50.765002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:50.765192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:50.783895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:50.785093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:50.802211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:50.854501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 575/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:51.132210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c890f-f76b-4193-a765-5aa1e488ecf0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:51.231221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c890f-f76b-4193-a765-5aa1e488ecf0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:51.248871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:51.266194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:51.266822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:51.267105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:51.267412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:51.268526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:51.269958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0c62-9e7b-40ea-bf07-5899a619b8ab None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:51.271559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 558/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:51.277625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:51.375227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477085-a504-411c-84fb-da01b6d561c1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:51.411751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:51.412354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:51.412633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:51.412931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:51.413668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:51.415101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ffbde-bb45-4866-bccf-e319c01b6737 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:51.441295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 576/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:02:51 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:53.631800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc046-da5a-4c9c-9bf7-9af305eecd3f None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:53.632886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc046-da5a-4c9c-9bf7-9af305eecd3f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:53.632886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecc046-da5a-4c9c-9bf7-9af305eecd3f None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:53.634180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 559/1135] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:53.639639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:53.640073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:53.640172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:53.647356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:53.659883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:53.661064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:53.726723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 577/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:53.995793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc046-da5a-4c9c-9bf7-9af305eecd3f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:54.095433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecc046-da5a-4c9c-9bf7-9af305eecd3f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:54.128853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:54.129474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:54.129753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:54.130030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:54.131121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:54.132616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b0d4c-7e65-414e-8785-468d300ca5f7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:54.134173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 560/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:54.140081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:54.239870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32b787-43a0-424d-a29b-94661b93e88e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:54.272068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:54.272604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:54.273400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:54.273671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:54.274307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:54.275799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc608da-f009-49ae-8a1e-10ab4516bea5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:54.284424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:54.297345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 578/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:02:54 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:02:56.493494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cb6f-d6c3-4b83-bd75-565909da6e58 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:56.494048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cb6f-d6c3-4b83-bd75-565909da6e58 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:56.494048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9cb6f-d6c3-4b83-bd75-565909da6e58 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:56.495473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 561/1139] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:02:56.500763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:56.501203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:56.501324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:56.520291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:02:56.521484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:02:56.588117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 579/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:02:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:02:56.856968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9cb6f-d6c3-4b83-bd75-565909da6e58 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:56.915792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:56.961569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9cb6f-d6c3-4b83-bd75-565909da6e58 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:56.995901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:56.996520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:56.996796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:56.997062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.006751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:02:57.011738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:02:57.012927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:02:57.014044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 562/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:02:57.018891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:57.114889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce32644-e01d-483e-83eb-9e4817aca0ca None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:57.135849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:57.150261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:57.150868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:57.151168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:57.151453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.152112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:57.152416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:57.153800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:57.161722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 580/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:57.167955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:57.267049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7700afb-d579-45a1-b532-a496329281a8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:57.281942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:57.302831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:57.303482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:57.303762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:57.304613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] PATH_INFO: `/v3/users/d5643931b6844148bb7c47e08788e59f` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.318397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] RBAC: Authorizing `identity:get_user(user_id=d5643931b6844148bb7c47e08788e59f)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:57.320762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:57.322375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 563/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:02:57 2022] GET /identity/v3/users/d5643931b6844148bb7c47e08788e59f => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:57.328223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:57.427758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041b97-9070-4a57-8a82-866143f0c850 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:57.462268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:57.462865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:57.463147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:57.463447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.512074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:57.530812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:57.532363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:57.628335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 581/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:02:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 19 11:02:57.635490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:57.733490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb56c10-6047-43b3-87ea-d58d790d8f2a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:57.766907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:57.767572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:57.767839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:57.768109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] PATH_INFO: `/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.769216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] RBAC: Authorizing `identity:get_project(project_id=cf6b9d1bdb514075bb4efd595fe9a92f)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:57.770641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c63ebe-098b-43ba-a68c-428abf3be0ea None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:57.772294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 564/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:02:57 2022] GET /identity/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:02:57.778904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:02:57.861479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:02:57.879875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee107-a33d-49bd-999b-9a73ce14aa2e None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:02:57.915215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:02:57.915830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:02:57.916109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:02:57.916384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:02:57.917116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=cf6b9d1bdb514075bb4efd595fe9a92f, user.id=d5643931b6844148bb7c47e08788e59f) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:02:57.917426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:02:57.918877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d39bc7-7290-45c5-bd5f-5b0c1c07c48e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:02:57.924732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 582/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:02:57 2022] GET /identity/v3/role_assignments?user.id=d5643931b6844148bb7c47e08788e59f&scope.project.id=cf6b9d1bdb514075bb4efd595fe9a92f&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:00.069734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28575a00-4775-4b1f-9cd2-aa6ec1b897fd None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:00.070309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28575a00-4775-4b1f-9cd2-aa6ec1b897fd None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:00.070405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28575a00-4775-4b1f-9cd2-aa6ec1b897fd None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:00.071709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 565/1147] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:00.076961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:00.077387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:00.077490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:00.096108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:00.097305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:00.162783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 583/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:00.436674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28575a00-4775-4b1f-9cd2-aa6ec1b897fd None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:00.479965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:00.536768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28575a00-4775-4b1f-9cd2-aa6ec1b897fd None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:00.571375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:00.572012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:00.572295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:00.572566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:00.582714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:03:00.588164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:00.589313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:03:00.590378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 566/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:00.595420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:00.669986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:00.693338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a5e8-e120-4cee-8b00-c9717f6c51dd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:00.727488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:00.728090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:00.728369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:00.728644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:00.729294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:00.729595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:00.730969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:00.738862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 584/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:00.744823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:00.841357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:00.844480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7297f6d-47c4-4995-a677-170849f12fb5 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:00.878542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:00.879185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:00.879481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:00.879759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] PATH_INFO: `/v3/users/d5643931b6844148bb7c47e08788e59f` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:00.880880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] RBAC: Authorizing `identity:get_user(user_id=d5643931b6844148bb7c47e08788e59f)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:00.882891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:00.884502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 567/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:03:00 2022] GET /identity/v3/users/d5643931b6844148bb7c47e08788e59f => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:00.890344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:00.997903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9edd3e-c247-4b1c-9c80-816c08893de2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:01.035059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:01.035713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:01.035994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:01.036268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] PATH_INFO: `/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:01.037381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] RBAC: Authorizing `identity:get_project(project_id=cf6b9d1bdb514075bb4efd595fe9a92f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:01.038928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1e74c-a23f-4c61-8afa-41999ff54868 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:01.040584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 585/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:03:00 2022] GET /identity/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:01.046661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:01.144929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf12b7-df4c-4eec-8ae7-9b6de02b1802 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:01.177654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:01.178306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:01.178587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:01.179415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] PATH_INFO: `/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f/users/d5643931b6844148bb7c47e08788e59f/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:01.181303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf6b9d1bdb514075bb4efd595fe9a92f, user_id=d5643931b6844148bb7c47e08788e59f, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:01.182776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21325-60ac-40f3-ac7e-5e4c8dc6a970 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:01.196438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 568/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:03:01 2022] PUT /identity/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f/users/d5643931b6844148bb7c47e08788e59f/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:03:03.333312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3fb-3dcd-489c-814c-be004a1cc8de None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:03.333848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3fb-3dcd-489c-814c-be004a1cc8de None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:03.333848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489d3fb-3dcd-489c-814c-be004a1cc8de None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:03.335961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 586/1154] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:03.341443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:03.341863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:03.342003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:03.360651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:03.361836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:03.384005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:03.428602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 569/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:03.700731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d3fb-3dcd-489c-814c-be004a1cc8de None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:03.711667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:03.802550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489d3fb-3dcd-489c-814c-be004a1cc8de None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:03.836854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:03.837475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:03.837751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:03.838022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:03.848042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:03:03.853182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:03.854303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:03:03.855409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 587/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:03.860377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:03.969268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607a816-5738-4845-b30c-cab7f7edce3d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:04.002270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:04.002875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:04.003187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:04.003463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:04.004119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:04.004420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:04.005799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:04.015085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 570/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:04.021099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:04.085897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:04.120309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9188-8547-4376-a25e-11717e4a15c6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:04.153438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:04.154060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:04.154337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:04.154609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] PATH_INFO: `/v3/users/d5643931b6844148bb7c47e08788e59f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:04.155739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] RBAC: Authorizing `identity:get_user(user_id=d5643931b6844148bb7c47e08788e59f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:04.157191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:04.158767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 588/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:03:04 2022] GET /identity/v3/users/d5643931b6844148bb7c47e08788e59f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:04.164756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:04.187115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:04.264566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd770f61-4501-437f-8549-4c4c72d0859a None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:04.297926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:04.298527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:04.298802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:04.299071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:04.364982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:04.367213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:04.386819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:04.464238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 571/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:03:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:03:04.470200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:04.568451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936c184-cb99-4084-ac74-12fb773eed31 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:04.601557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:04.602239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:04.602516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:04.602785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] PATH_INFO: `/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:04.603937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] RBAC: Authorizing `identity:get_project(project_id=cf6b9d1bdb514075bb4efd595fe9a92f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:04.605375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2aa07d-5118-4a4c-aef7-fd059b1516f8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:04.606988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 589/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:03:04 2022] GET /identity/v3/projects/cf6b9d1bdb514075bb4efd595fe9a92f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:04.613224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:04.710888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5c0cd-4a07-46b9-81c3-30b03ff524bc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:04.731281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:04.745279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:04.745879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:04.746159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:04.746433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:04.747138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=cf6b9d1bdb514075bb4efd595fe9a92f, user.id=d5643931b6844148bb7c47e08788e59f) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:04.747479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:04.748904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8b562-d1e4-465a-b085-71a9eedaa37f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:04.754557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 572/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:03:04 2022] GET /identity/v3/role_assignments?user.id=d5643931b6844148bb7c47e08788e59f&scope.project.id=cf6b9d1bdb514075bb4efd595fe9a92f&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:06.916166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b2-e047-4dc7-9caa-1770799c3256 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:06.916746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b2-e047-4dc7-9caa-1770799c3256 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:06.916746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67f8b2-e047-4dc7-9caa-1770799c3256 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:06.918044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 590/1162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:06.923689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:06.924158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:06.924265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:06.943027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:06.944975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:07.012535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 573/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:07.280467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f8b2-e047-4dc7-9caa-1770799c3256 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:07.283357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:07.383570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67f8b2-e047-4dc7-9caa-1770799c3256 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:07.416935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:07.417533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:07.417815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:07.418088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:07.486340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:07.487830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:07.489629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:07.586509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 591/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:03:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:03:07.592528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:07.688549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddfb3e-7390-4140-a192-6a46331c84cc None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:07.703083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:07.723578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:07.724202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:07.724774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:07.724774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:07.731843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:07.733293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-402dd012-db5f-46e7-b5bc-a7e2a6c64d6a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:07.744739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:07.746010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:03:07.747193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 574/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:03:07 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:07.752008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:07.849645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f62a-e4f2-4c83-9fd3-0bb20bb30cd6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:07.851962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:07.885014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:07.885616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:07.885900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:07.886177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:07.886807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:07.887112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:07.888528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ea56e-7f84-42c5-bbf3-845e26fe6f05 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:07.895562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 592/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Sep 19 11:03:07 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:10.050813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d067-33e8-4e83-a38b-c8bbcd9f8bc6 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:10.051381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d067-33e8-4e83-a38b-c8bbcd9f8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:10.051381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8d067-33e8-4e83-a38b-c8bbcd9f8bc6 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:10.052726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 575/1167] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:10.059212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae591-7d78-40e2-862c-787af1ffe491 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:10.059659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae591-7d78-40e2-862c-787af1ffe491 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:10.059764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae591-7d78-40e2-862c-787af1ffe491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:10.078600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e81ae591-7d78-40e2-862c-787af1ffe491 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:10.079848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e81ae591-7d78-40e2-862c-787af1ffe491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:10.149515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 593/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:10.424058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d067-33e8-4e83-a38b-c8bbcd9f8bc6 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:10.523564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8d067-33e8-4e83-a38b-c8bbcd9f8bc6 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:10.555847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:10.556434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:10.556711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:10.556981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:10.557635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:10.559001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b7d87-5d3f-4e46-9871-f42a26e871a0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:10.575356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 576/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Mon Sep 19 11:03:10 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:03:12.763100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdafe4a-6372-4202-a225-5c2a9b675861 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:12.763672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdafe4a-6372-4202-a225-5c2a9b675861 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:12.763672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdafe4a-6372-4202-a225-5c2a9b675861 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:12.765012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 594/1170] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:12.770342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:12.770775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:12.770870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:12.789985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:12.791179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:12.817277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:12.859007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 577/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:13.146901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdafe4a-6372-4202-a225-5c2a9b675861 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:13.242435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:13.249997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdafe4a-6372-4202-a225-5c2a9b675861 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:13.284752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:13.285387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:13.285668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:13.285943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] PATH_INFO: `/v3/domains/a7bac27331624491875619d0ab3e4248` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:13.297186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7bac27331624491875619d0ab3e4248)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:13.298685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18476f7c-9682-4196-b0c5-7bf4255540c8 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:13.300320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 595/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Sep 19 11:03:13 2022] GET /identity/v3/domains/a7bac27331624491875619d0ab3e4248 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:03:13.306868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:13.402484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aac2e-1969-45c1-b8bf-83d5fc5b9a6a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:13.436247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:13.436852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:13.437132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:13.437404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:13.438059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:13.439515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56e1c8-1522-4031-b0ef-534433e286b9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:13.466021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 578/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:03:13 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:03:15.677308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef526-224a-469c-b9a3-5c436d364ec8 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:15.677846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef526-224a-469c-b9a3-5c436d364ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:15.677846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef526-224a-469c-b9a3-5c436d364ec8 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:15.679737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 596/1174] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:15.685290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:15.685845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:15.685845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:15.705146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:15.706357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:15.718765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:15.775808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 579/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:16.056606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef526-224a-469c-b9a3-5c436d364ec8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:16.161818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef526-224a-469c-b9a3-5c436d364ec8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:16.199023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:16.199689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:16.199974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:16.200250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] PATH_INFO: `/v3/domains/a7bac27331624491875619d0ab3e4248` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:16.201390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=a7bac27331624491875619d0ab3e4248)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:16.202881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ea897-b645-4866-b322-8aed08b64b6a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:16.204525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 597/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Sep 19 11:03:16 2022] GET /identity/v3/domains/a7bac27331624491875619d0ab3e4248 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:16.213687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:16.324056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9b9c-9ddb-45ff-8929-58e28494b5ee None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:16.362578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:16.363217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:16.363502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:16.363773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:16.364446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:16.366522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c9382-131c-462d-ad0d-456542b7bef9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:16.389559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 580/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:03:16 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:03:18.619773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe624-e8e7-430d-b86e-843407b3b962 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:18.620299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe624-e8e7-430d-b86e-843407b3b962 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:18.620299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe624-e8e7-430d-b86e-843407b3b962 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:18.621575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 598/1178] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:18.626938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:18.627409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:18.627625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:18.634376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:18.649122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:18.650328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:18.717068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 581/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:03:18.990129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe624-e8e7-430d-b86e-843407b3b962 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:19.016698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:19.094772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe624-e8e7-430d-b86e-843407b3b962 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:19.129483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:19.130118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:19.130403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:19.130679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:19.141944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:03:19.147550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:19.149285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:03:19.150336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 599/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:19.155606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:19.258534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5110c93-1af6-4208-bf64-d0fc64a323aa None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:19.289339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:19.295005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:19.295637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:19.295910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:19.296177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:19.296826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:19.297122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:19.298479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:19.307279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 582/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:19.313389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:19.396085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:19.411481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a825d-4984-4b19-8d37-8f36e4b49786 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:19.446064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:19.446680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:19.446961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:19.447266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] PATH_INFO: `/v3/users/0abd6b179956457290dcb1867e90370c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:19.460599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] RBAC: Authorizing `identity:get_user(user_id=0abd6b179956457290dcb1867e90370c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:19.462043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:19.463678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 600/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:03:19 2022] GET /identity/v3/users/0abd6b179956457290dcb1867e90370c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:19.469509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:19.567413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7fc12-e472-4d39-a45e-cf1d563e1752 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:19.600878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:19.601612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:19.602122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:19.602392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:19.661105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:19.669307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:19.670765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:19.766201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 583/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:03:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:03:19.773047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:19.871428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c3639-00d5-4648-b3e9-37a024e9e82d None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:19.905717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:19.906382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:19.906618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:19.906889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] PATH_INFO: `/v3/projects/f755403359c34613acb533a25ae5b9d6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:19.908038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] RBAC: Authorizing `identity:get_project(project_id=f755403359c34613acb533a25ae5b9d6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:19.909491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28736eaf-055d-428d-b415-bc8e3b2e2e03 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:19.911141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 601/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:03:19 2022] GET /identity/v3/projects/f755403359c34613acb533a25ae5b9d6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:19.918248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:20.009449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:20.016575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bded8-ffdf-43d5-98df-f5d17dd22347 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:20.051078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:20.051700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:20.052020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:20.052255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:20.053006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=f755403359c34613acb533a25ae5b9d6, user.id=0abd6b179956457290dcb1867e90370c) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:20.053313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:20.054759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d273889-731e-4498-aab9-398aaa360bd6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:20.060482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 584/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:03:19 2022] GET /identity/v3/role_assignments?user.id=0abd6b179956457290dcb1867e90370c&scope.project.id=f755403359c34613acb533a25ae5b9d6&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:22.232742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803912-f180-4799-a1e9-971313a19868 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:22.233447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803912-f180-4799-a1e9-971313a19868 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:22.233447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff803912-f180-4799-a1e9-971313a19868 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:22.234598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 602/1186] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:22.239739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:22.240166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:22.240349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:22.258792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:22.260009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:22.327359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 585/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:03:22.600254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff803912-f180-4799-a1e9-971313a19868 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:22.612800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:22.704443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff803912-f180-4799-a1e9-971313a19868 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:22.739147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:22.739812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:22.740100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:22.740910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:22.751522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:03:22.756997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:22.758189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:03:22.759185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 603/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:22.764550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:22.853594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:22.866563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170185-39b1-42eb-b8cc-a1f5f9d719fa None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:22.901436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:22.902048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:22.902325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:22.902599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:22.903749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:22.903749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:22.904948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:22.913735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 586/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:22.919626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:22.989551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:23.020978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b013ee7-80c8-4ef0-88e4-fdf80a747901 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:23.055686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:23.056303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:23.056583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:23.056856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] PATH_INFO: `/v3/users/0abd6b179956457290dcb1867e90370c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:23.057965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] RBAC: Authorizing `identity:get_user(user_id=0abd6b179956457290dcb1867e90370c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:23.059444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:23.061019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 604/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:03:22 2022] GET /identity/v3/users/0abd6b179956457290dcb1867e90370c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:23.067266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:23.165452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fa80d-9bb6-4677-a3b5-a87fb1243cad None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:23.198398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:23.199023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:23.199331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:23.199606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] PATH_INFO: `/v3/projects/f755403359c34613acb533a25ae5b9d6` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:23.200718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] RBAC: Authorizing `identity:get_project(project_id=f755403359c34613acb533a25ae5b9d6)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:23.202149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64058f8f-9b71-4e1e-93d4-ab384f670d23 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:23.203800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 587/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:03:23 2022] GET /identity/v3/projects/f755403359c34613acb533a25ae5b9d6 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:23.210022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:23.309504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27240-b58f-464a-8b14-0bd90a276779 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:23.342972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:23.343648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:23.343932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:23.344209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] PATH_INFO: `/v3/projects/f755403359c34613acb533a25ae5b9d6/users/0abd6b179956457290dcb1867e90370c/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:23.346084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] RBAC: Authorizing `identity:create_grant(project_id=f755403359c34613acb533a25ae5b9d6, user_id=0abd6b179956457290dcb1867e90370c, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:23.347559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74083f-a34b-46c7-8592-475cdba292ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:23.355920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:23.361860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 605/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:03:23 2022] PUT /identity/v3/projects/f755403359c34613acb533a25ae5b9d6/users/0abd6b179956457290dcb1867e90370c/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:03:25.515432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483822e0-25e7-4ae9-9506-d552b95892bc None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:25.516003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483822e0-25e7-4ae9-9506-d552b95892bc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:25.516003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483822e0-25e7-4ae9-9506-d552b95892bc None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:25.517310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 588/1193] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:03:25.523680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:25.524157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:25.524259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:25.542717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:03:25.543874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:03:25.609735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 606/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:03:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 19 11:03:25.881815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483822e0-25e7-4ae9-9506-d552b95892bc None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:25.901773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:25.984716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483822e0-25e7-4ae9-9506-d552b95892bc None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.018397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.019017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.019339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.019608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.029831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:03:26.034619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:03:26.035780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:03:26.036643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 589/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:03:26.042450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:26.148026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9d3ee-3963-49b7-89e7-ab0769b7dfab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.173982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:26.182717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.183354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.183638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.183912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.184566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:26.184872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:26.186261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:26.194785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 607/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:26.201005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:26.282564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:26.306627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef50eb3-8e63-4000-81ec-0fe957f3d443 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.343821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.344458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.344741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.345020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] PATH_INFO: `/v3/users/0abd6b179956457290dcb1867e90370c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.346156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] RBAC: Authorizing `identity:get_user(user_id=0abd6b179956457290dcb1867e90370c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:26.347660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:26.349381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 590/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Sep 19 11:03:26 2022] GET /identity/v3/users/0abd6b179956457290dcb1867e90370c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:26.356572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:26.461285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756ea0-e3ba-4e9f-94f0-cb89d011c3cc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.496049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.496653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.496936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.497209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.557993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:26.569080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:26.570556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:26.672068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 608/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:03:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:03:26.678407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:26.777691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7081-1ce8-49de-b8c6-9d395efcc91f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.810271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.810895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.811199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.811474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] PATH_INFO: `/v3/projects/f755403359c34613acb533a25ae5b9d6` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.812606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] RBAC: Authorizing `identity:get_project(project_id=f755403359c34613acb533a25ae5b9d6)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:26.814036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade2925-f0c2-483f-a1ea-12aeff6d6190 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:26.815981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 591/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Sep 19 11:03:26 2022] GET /identity/v3/projects/f755403359c34613acb533a25ae5b9d6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:26.822710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:03:26.917141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:26.927406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a6623-e853-4ab8-90a5-d6c84e2ef02a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:03:26.963637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:03:26.964247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:03:26.964527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:03:26.964806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:03:26.965524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=f755403359c34613acb533a25ae5b9d6, user.id=0abd6b179956457290dcb1867e90370c) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:03:26.965838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:03:26.967323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3c362-f542-4458-ad8e-68e20232460b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:03:26.973582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 609/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:03:26 2022] GET /identity/v3/role_assignments?user.id=0abd6b179956457290dcb1867e90370c&scope.project.id=f755403359c34613acb533a25ae5b9d6&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:03:36.806077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:03:36.971050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=23 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:24.352563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a643-3672-4fa5-99b5-bda8eb28d43e None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:24.353214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a643-3672-4fa5-99b5-bda8eb28d43e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:24.353214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19a643-3672-4fa5-99b5-bda8eb28d43e None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:24.354619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 592/1201] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:24.361180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:24.361682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:24.361777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:24.383363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:24.384677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:24.475109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 610/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:24.774583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a643-3672-4fa5-99b5-bda8eb28d43e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:24.928214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19a643-3672-4fa5-99b5-bda8eb28d43e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:24.969906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:24.970613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:24.970898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:24.971190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:24.987608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:24.989332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:25.008708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:25.010134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:25.011742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:25.011742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:25.011742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:25.011742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 593/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:25.016465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:25.142243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589e30b-0e51-4c0f-96b1-eab6fefb4d92 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:25.177367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:25.184700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:25.185645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:25.185875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:25.186188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:25.186838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:25.187179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:25.188660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9ac0-3a5d-46ec-b9c3-e6383903284e None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:25.201739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 611/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:25.208272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:25.294139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:25.360592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeaa7c-d92c-4bf1-8ccf-2491d811be40 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:25.414772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:25.415367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:25.415647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:25.415920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:25.416566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:25.418196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c626c-bdcd-4fa0-b88c-57e44b147250 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:25.444022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 594/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Sep 19 11:04:25 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:04:27.886919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70f30-a605-467b-bf0f-b1b438abcc33 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:27.887495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70f30-a605-467b-bf0f-b1b438abcc33 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:27.887495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d70f30-a605-467b-bf0f-b1b438abcc33 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:27.889040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 612/1206] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:27.895617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:27.896202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:27.896202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:27.918927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:27.920339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:28.004502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 595/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:28.278234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d70f30-a605-467b-bf0f-b1b438abcc33 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:28.418318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d70f30-a605-467b-bf0f-b1b438abcc33 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:28.460501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:28.460959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:28.461273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:28.461588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:28.474348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:28.479335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:28.480323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:28.481199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 613/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:28.486849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:28.532635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:28.606186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5c7b1-310a-496f-a757-ad2fe6b9827c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:28.650329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:28.650957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:28.651350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:28.651514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:28.652160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:28.652483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:28.654077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:28.667500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 596/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:28.669001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:28.735813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:28.795425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94a81-991c-4685-a5ac-095a6467f46b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:28.841066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:28.841066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:28.841066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:28.841464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:28.853597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:28.855257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:28.872120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:28.874324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:28.875367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:28.875367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:28.875367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:28.875367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 614/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:28.880190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:29.006504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:29.011033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17065e-e6d1-4c55-ab13-f46cdeae09f4 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:29.054000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:29.054564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:29.054873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:29.055147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:29.055893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:29.056231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:29.057770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:29.072502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 597/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:29.078120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:29.199299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2a43-d030-43fc-9f0c-2271438c9b8a None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:29.200972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:29.238244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:29.238878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:29.239178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:29.239454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:29.248083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:29.249792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:29.262793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:29.264008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:29.265195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:29.267081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 615/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:29.274121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:29.394831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55778-31b8-460b-b487-19a7f689bead None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:29.433941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:29.434524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:29.434912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:29.435243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:29.436157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:29.436470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:29.438132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:29.459914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 598/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:29.465504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:29.582474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152deffa-a60c-47e0-bd8c-01ff2fec40f6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:29.622278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:29.622911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:29.623181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:29.623476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:29.656760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:29.703310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:29.705011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:29.832422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 616/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:04:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:04:29.838586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:29.862731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:29.967669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56ed70-de7e-43f2-99e6-86d6edd7375f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:30.015833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:30.016544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:30.016758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:30.017025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:30.029626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:30.031097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:30.047317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:30.048498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:30.054716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:30.054716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:30.054716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:30.054716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 599/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:30.055006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:30.130371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:30.183524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022720ee-88db-4a63-bd0a-2c2ad6c7ccd2 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:30.225244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:30.225798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:30.226108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:30.226469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:30.227104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:30.227527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:30.229238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:30.242940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 617/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:30.249264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:30.330445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:30.365964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a123b3-4962-49c7-b134-b430d4c1eef6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:30.411202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:30.411913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:30.412253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:30.412665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:30.421213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:30.423471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:30.440278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:30.441935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:30.443236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 600/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:30.450075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:30.566058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea909a8f-1140-471b-a710-c941660be939 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:30.592231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:30.605360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:30.605959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:30.606237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:30.606511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:30.607212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:30.607516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:30.608941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43e526-2471-406c-b167-efe0c23d744b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:30.622782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 618/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:30.630459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:30.766811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152efa0d-44cc-48da-9f38-a6c86475334b None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:30.799791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:30.808339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:30.809014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:30.809338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:30.809620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:30.810450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=13f59c80064f44f59abc5defb5515fd9) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:30.810935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:30.812431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc4aec-9179-4106-81bc-e415387f1948 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:30.819913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 601/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:04:30 2022] GET /identity/v3/role_assignments?user.id=13f59c80064f44f59abc5defb5515fd9&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:33.089871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646701c-bf56-4cb2-93f7-a12dbbcb8da9 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:33.090433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646701c-bf56-4cb2-93f7-a12dbbcb8da9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:33.090433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646701c-bf56-4cb2-93f7-a12dbbcb8da9 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:33.091755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 619/1220] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:33.097768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:33.098293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:33.098558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:33.118909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:33.120256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:33.197091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 602/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:33.472442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646701c-bf56-4cb2-93f7-a12dbbcb8da9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:33.582927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646701c-bf56-4cb2-93f7-a12dbbcb8da9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:33.625073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:33.625823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:33.626139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:33.626459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:33.638523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:33.644791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:33.646020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:33.647092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 620/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:04:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:04:33.652210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:33.762681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1ca63-3608-4c6e-988e-8ee595d58910 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:33.790977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:33.809733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:33.811401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:33.812532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:33.812903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:33.814778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] RBAC: Adding query filter params (name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:33.815664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:33.818654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:33.830645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 603/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:04:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:33.837795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:33.888808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:33.951512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39c342-df08-4c8a-92c8-b056465bef70 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:33.988487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:33.989285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:33.989602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:33.989939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.002694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.004678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:34.023262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:34.024947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:34.026539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:34.026539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:34.026539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:34.026539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 621/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:34.030826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.152852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9119f1-b0ec-4c5d-8ac6-a531a99d5b42 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:34.191931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:34.192520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:34.192798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:34.193070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.193731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:34.194033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.195453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.210934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 604/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:04:34.217071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.322822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:34.331076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ab9e2-1335-4ab3-a65e-7d68a115bad6 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:34.370277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:34.370916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:34.371252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:34.371593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.379695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.382499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:34.396328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:34.397474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:34.398438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 622/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:34.404053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.458927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:34.514049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815564a-2f4d-4148-bc7b-6657ef32fcbd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:34.553152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:34.553694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:34.553977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:34.554323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.555050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:34.555390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.557115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.584039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 605/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:34.585560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.707490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095f21d-0781-436d-909b-4b92e2d976f0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:34.749891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:34.750568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:34.750854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:34.751129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.765785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.767361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:34.783474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:34.785897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:34.787553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:34.787553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:34.787553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:34.787553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 623/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:34.791417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.922846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a540a3-3cd5-4bea-8752-85bea118b1e8 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:34.926365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:34.961309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:34.962059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:34.962453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:34.962800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:34.963714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:34.964030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:34.965468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:34.978620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 606/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:34.984477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:34.995458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:35.097057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab83bf-18bd-434d-a2e5-7067be0d5ccc None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:35.134317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:35.135121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:35.135436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:35.135709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:35.142822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:35.145256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:35.159842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:35.161014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:35.161942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 624/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:35.167221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:35.295402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa231a0b-f4d5-4be2-bcd7-af8c72c68a56 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:35.335324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:35.335977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:35.336345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:35.336640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:35.337413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:35.337727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:35.339406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb1a6d-18da-4349-bc3d-84cd6807f42d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:35.357838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 607/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:35.366067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:35.445498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:35.485848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adfe57-08a9-4821-8969-2aad17d0c751 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:35.527296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:35.527985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:35.528252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:35.528617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/13f59c80064f44f59abc5defb5515fd9/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:35.546791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=13f59c80064f44f59abc5defb5515fd9, role_id=c9fc98bfb2bf441d9fe94ea6dce6e6f5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:35.548436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c08e0-d858-432f-a6c5-009c16e737db None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:35.562818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 625/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:04:35 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/13f59c80064f44f59abc5defb5515fd9/roles/c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:04:37.751055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f902cb-57ca-4648-bd03-d0d126aa2ad3 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:37.751766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f902cb-57ca-4648-bd03-d0d126aa2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:37.751766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f902cb-57ca-4648-bd03-d0d126aa2ad3 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:37.753160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 608/1233] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:37.759060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:37.759572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:37.759666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:37.781375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:37.783236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:37.877190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 626/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:38.184548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f902cb-57ca-4648-bd03-d0d126aa2ad3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:38.212986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:38.303387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f902cb-57ca-4648-bd03-d0d126aa2ad3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:38.343651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:38.344323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:38.344617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:38.344917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:38.357102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:38.362579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:38.363789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:38.364842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 609/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Sep 19 11:04:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:38.369766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:38.422474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:38.484789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d7f12-81e9-4855-aea5-c98471fdd113 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:38.527257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:38.527943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:38.528243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:38.528553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:38.529234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:38.529556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:38.531018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:38.540492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 627/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Sep 19 11:04:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:38.546258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:38.635079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:38.655668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ceef-9bd7-4159-86c8-ea1af2086e39 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:38.692686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:38.693317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:38.693593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:38.693860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:38.704223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:38.705673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:38.721576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:38.722937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:38.724019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:38.724019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:38.724019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:38.724019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 610/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:38.729040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:38.846227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdac2c5-0f4f-43c2-9935-36601f9142e0 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:38.864543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:38.893639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:38.894346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:38.894661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:38.894963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:38.895656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:38.896045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:38.897613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:38.911864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 628/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:38.918019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:39.036472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2540a2d-a361-45c7-990c-a340607867e0 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:39.074843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:39.075556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:39.075835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:39.076154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:39.079078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:39.085332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:39.087032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:39.100385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:39.101744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:39.102735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 611/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:39.108012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:39.221868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03710-7f51-472c-9350-fddb28a4e6f5 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:39.261827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:39.262486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:39.262784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:39.263080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:39.263956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:39.264320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:39.266007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:39.285568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 629/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:39.291592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:39.409596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e246-9889-44ac-9f69-159862e32b72 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:39.447032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:39.447670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:39.447949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:39.448220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:39.519256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:39.527034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:39.528716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:39.637019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 612/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:04:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:04:39.642879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:39.673905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:39.758607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfe169-be64-40ac-b0f2-a62a5d275cd4 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:39.819767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:39.820766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:39.821261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:39.821765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:39.839604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:39.841793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:39.867663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:39.869237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:39.870142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:39.870142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:39.870142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:39.870142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 630/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:39.875520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:39.985296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:39.991005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdfdf1-792c-446c-a851-af44ebc9c957 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:40.031419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:40.032031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:40.032308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:40.032609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:40.033241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:40.033542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:40.035622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:40.047527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 613/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:04:40.053934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:40.146893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:40.171090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772b22-3b2f-4743-91ab-265e59c2ee36 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:40.210337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:40.211035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:40.211383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:40.211651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:40.219048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:40.220470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:40.238370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:40.240506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:40.241514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 631/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:40.246117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:40.398950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b447bb-1e01-41a2-bda8-18727d51ee8f None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:40.438829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:40.439472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:40.439995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:40.440451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:40.441460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:40.441769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:40.443218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68fbf3-8aa2-4078-8d17-00301fab8543 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:40.455227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 614/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:40.462019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:40.577379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87631934-c6c4-4e0a-8f00-3b043ecc97ac None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:40.617400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:40.618063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:40.618354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:40.618687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:40.619439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] RBAC: Adding query filter params (role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=13f59c80064f44f59abc5defb5515fd9) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:40.619751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:40.621387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a783df-2d26-46a7-afd1-fc9990f68049 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:40.628653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 632/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:04:40 2022] GET /identity/v3/role_assignments?user.id=13f59c80064f44f59abc5defb5515fd9&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=c9fc98bfb2bf441d9fe94ea6dce6e6f5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:43.031214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522473-9e47-4a5b-b6f2-18223c5f1625 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:43.031823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522473-9e47-4a5b-b6f2-18223c5f1625 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:43.031928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe522473-9e47-4a5b-b6f2-18223c5f1625 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:43.033435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 615/1247] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:43.039244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:43.039774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:43.039897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:43.047134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:43.062625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:43.063976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:43.139191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 633/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:43.409830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522473-9e47-4a5b-b6f2-18223c5f1625 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:43.428551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:43.529411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe522473-9e47-4a5b-b6f2-18223c5f1625 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:43.565075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:43.566023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:43.566398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:43.566673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:43.577890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:43.584977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:43.586131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:43.587195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 616/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:43.592621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:43.702121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa159f-44b1-442c-a8c9-8e54618a5876 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:43.732876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:43.739667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:43.740288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:43.740574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:43.740849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:43.741514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:43.741830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:43.743333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:43.752008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 634/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:43.758889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:43.856606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:43.886072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df245ec-770b-4424-94b7-f2183220dcbd None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:43.926944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:43.927758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:43.928108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:43.928381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:43.940805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:43.942638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:43.960460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:43.961539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:43.962488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:43.962488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:43.962488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:43.962488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 617/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:43.967843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:44.086351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0f2bd-dee3-4506-96d0-756fea273170 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:44.127365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:44.127889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:44.128182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:44.128507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:44.129164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:44.129471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:44.130948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:44.143542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 635/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:44.149381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:44.269230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b96e9-b4fd-4743-8f72-cbe9923c2ee9 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:44.298386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:44.309264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:44.309923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:44.310213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:44.310476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:44.319702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:44.321372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:44.335543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:44.338034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:44.339113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 618/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:44.342749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:44.413075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:44.463320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7699b3-08e4-41a5-a17c-0e93a44b52d9 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:44.500614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:44.501278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:44.501560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:44.501834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:44.502644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:44.502951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:44.504486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:44.525214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 636/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:44.531149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:44.636587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e2053-0982-4712-9815-0611ec1b2ca7 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:44.673191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:44.673716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:44.673995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:44.674876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:44.735135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:44.749142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:44.750623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:44.866701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 619/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:04:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:04:44.872604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:44.986626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941535-ebb7-4855-95dd-5537830cec83 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:45.001135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:45.023170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:45.023805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:45.024079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:45.024346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:45.035602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:45.037153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:45.053286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:45.054302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:45.055268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:45.055268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:45.055268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:45.055268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 637/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:45.060409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:45.150388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:45.162643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250d3d3-b9be-4131-b2bf-56e5fef6f97d None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:45.197558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:45.198153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:45.198465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:45.198780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:45.199365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:45.199669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:45.201034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:45.212478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 620/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:45.218160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:45.319000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676afe16-444e-4a3b-b0fa-9d051506f473 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:45.351534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:45.352157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:45.352434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:45.352702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:45.359248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:45.360697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:45.372501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:45.373557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:45.374888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 638/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:45.380055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:45.478040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b246a-18d1-41f3-9b25-e8c2c23f8042 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:45.511318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:45.511919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:45.512196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:45.512469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:45.513146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:45.513451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:45.514874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771d9d2-f077-445f-80a4-ed964a887966 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:45.526463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 621/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:45.532729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:45.560077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:45.633380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac316c-afe0-40eb-8f7f-5138074be90b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:45.666170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:45.666755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:45.667030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:45.667328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:45.668035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=13f59c80064f44f59abc5defb5515fd9) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:45.668335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:45.669769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa86497-0ce9-493e-8bfa-ca188866e0c1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:45.675832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 639/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:04:45 2022] GET /identity/v3/role_assignments?user.id=13f59c80064f44f59abc5defb5515fd9&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:47.844010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a65bf-6ac8-4934-871d-2a9169a9eb95 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:47.844575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a65bf-6ac8-4934-871d-2a9169a9eb95 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:47.844575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a65bf-6ac8-4934-871d-2a9169a9eb95 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:47.845976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 622/1261] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:47.853283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:47.853807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:47.854086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:47.876111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:47.878312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:47.958412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 640/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:48.227275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a65bf-6ac8-4934-871d-2a9169a9eb95 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:48.238686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:48.333583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a65bf-6ac8-4934-871d-2a9169a9eb95 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:48.367778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:48.368395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:48.368675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:48.368945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:48.379456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:48.384276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:48.385384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:48.386428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:48.390523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 623/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:48.391560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:48.409787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:48.491516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946783e2-dd2e-4430-88a2-1a0dd5e3184d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:48.524604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:48.525199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:48.525477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:48.525747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:48.526393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:48.526689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:48.528106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:48.536762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 641/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:48.542546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:48.608775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:48.641899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af052ca3-11c6-4dbe-965e-a34ab0f72cdc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:48.675937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:48.676555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:48.676830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:48.677098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:48.686881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:48.688347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:48.702946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:48.704096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:48.704999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:48.704999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:48.704999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:48.704999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 624/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:48.710185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:48.791996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:48.813210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bd3dd-3f16-4f14-b078-3bfc2844056b None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:48.855779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:48.856633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:48.856832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:48.857162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:48.857942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:48.858324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:48.860026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:48.872812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 642/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:48.878657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:48.978314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce1f6b-2a1a-440c-850a-e15216721efc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:48.998812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:49.013737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.014365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.014645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.014913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.024327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.025781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:49.037759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:49.038877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:49.039910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 625/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:49.044815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.143341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b8b1e-a214-46fb-80ee-274441ff5599 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.177620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.178217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.178499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.178776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.179528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:49.179837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.181281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.190713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:49.200147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 643/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:49.206749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.303234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09039c4-00e8-4f97-8129-7f5ccfeb0fcc None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.336951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.337572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.337849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.338119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.348598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.350039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:49.363827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:49.364939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:49.365851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:49.365851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:49.365851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:49.365851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 626/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:49.370809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.470114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfc22f-1b88-453b-9bc6-a07f95adb5d3 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.504230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.504823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.505105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.505377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.506004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:49.506304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.507714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.518727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 644/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:49.524620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.555890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:49.624123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8412da-e9bd-4e90-85d4-46cf444bc6e6 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.657686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.658323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.658738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.659242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.665762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.667213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:49.679011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:49.680160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:49.681100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 627/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:49.686342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.744091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:49.785441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5fc54-d380-47c0-bde4-3d2f391040cd None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.823395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.823927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.824207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.824479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.825161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:49.825466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.826908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0f4cc-a701-420d-8335-4298341705e1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.839201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 645/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:49.845260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:49.937404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:49.947768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e07ef-7ff0-4757-8020-40cf08ea9298 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:49.980917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:49.981560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:49.981841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:49.982116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] PATH_INFO: `/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/13f59c80064f44f59abc5defb5515fd9/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:49.984042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] RBAC: Authorizing `identity:create_grant(project_id=b183d5255b80400ba5b8ab006def60cd, user_id=13f59c80064f44f59abc5defb5515fd9, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:49.985480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a61f6a-6e9e-47fa-8a7e-0d7525dc2a12 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:49.999095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 628/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Sep 19 11:04:49 2022] PUT /identity/v3/projects/b183d5255b80400ba5b8ab006def60cd/users/13f59c80064f44f59abc5defb5515fd9/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:04:52.147699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06781a7-4c61-4000-9d1e-4e1b4d0298e3 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:52.148278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06781a7-4c61-4000-9d1e-4e1b4d0298e3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:52.148278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06781a7-4c61-4000-9d1e-4e1b4d0298e3 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:52.149584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 646/1274] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:52.154970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:52.155409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:52.155568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:52.174379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:52.175634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:52.240948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 629/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:52.516580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06781a7-4c61-4000-9d1e-4e1b4d0298e3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:52.617885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06781a7-4c61-4000-9d1e-4e1b4d0298e3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:52.635510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:52.652505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:52.653127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:52.653399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:52.653666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:52.664425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 19 11:04:52.669164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:52.670351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:52.671340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 647/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Sep 19 11:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:52.676774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:52.757892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:52.776990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073f17-3520-4c3f-a12a-d0c6910c5929 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:52.815868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:52.816609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:52.816963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:52.817263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:52.818153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:52.818483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:52.820443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:52.830301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 630/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Sep 19 11:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:52.837098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:52.941364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc333ff-922c-4e0a-a897-5ed70dd234a7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:52.975037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:52.975694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:52.975977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:52.976251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:52.985951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:52.988057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:53.002948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:53.004153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:53.005274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:53.005274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:53.005274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:53.005274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 648/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:53.010090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:53.109572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06430-4cd4-4f0d-83b8-973a21900061 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:53.142379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:53.143733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:53.144018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:53.144296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:53.144928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:53.145232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:53.146611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.158045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 631/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:53.163930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:53.194302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:53.262519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b2da-9b8e-495e-b58b-9cc267dcc136 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:53.296364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:53.296988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:53.297265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:53.297536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:53.304912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:53.306352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 19 11:04:53.318082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:53.319125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:53.320571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 649/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:53.325064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:53.329253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:53.425784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cab09-e2db-4393-b7cd-6dc8409232af None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:53.459207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:53.459816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:53.460102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:53.460382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:53.461094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:53.461399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:53.462832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.480123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 632/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:53.485926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:53.574876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:53.585211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07be0-711c-470c-b8e8-5e3abf6763eb None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:53.625173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:53.625774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:53.626055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:53.626331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:53.693102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:53.694490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.782402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:53.794526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 650/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 19 11:04:53.800648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:53.863810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:53.903651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29489eda-335b-4770-9320-65cab464bd6e None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:53.937726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:53.938351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:53.938632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:53.938905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:53.949814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:53.951224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 19 11:04:53.966234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:53.967437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 19 11:04:53.968568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 19 11:04:53.968568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 19 11:04:53.968568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:53.968568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 633/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:53.973454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:54.071980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a0bda-9b4e-412b-a56a-5e465399f7b1 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:54.105498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:54.106095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:54.106374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:54.106645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:54.107301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:54.107602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:54.108977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:54.120438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 651/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Sep 19 11:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:54.126149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:54.226521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cf2ff-b234-4235-8b0e-656f92746251 None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:54.240450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:54.261783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:54.262406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:54.262689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:54.262964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:54.269571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:54.271011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 19 11:04:54.283182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:54.284699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: ERROR keystone.server.flask.application Sep 19 11:04:54.286098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 634/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Sep 19 11:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:54.290173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:54.340353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:54.390796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de13eb-8650-462c-9986-eb61270c409f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:54.423718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:54.424931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:54.425216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:54.425491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:54.426172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:54.426500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:54.427949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401abdd1-b84b-4e32-9b66-2d1087daf642 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:54.440387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 652/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Sep 19 11:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:54.447615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:54.544443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ed3bb-5050-4201-abdf-ebf1b20708ac None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:54.576870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417232b-4673-488a-b937-5c251248097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:54.577466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417232b-4673-488a-b937-5c251248097e None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:54.577740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417232b-4673-488a-b937-5c251248097e None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:54.578020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417232b-4673-488a-b937-5c251248097e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:54.578713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417232b-4673-488a-b937-5c251248097e None admin] RBAC: Adding query filter params (role.id=776f1e2ca524448593a9fae01b68a6f1, scope.project.id=b183d5255b80400ba5b8ab006def60cd, user.id=13f59c80064f44f59abc5defb5515fd9) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:54.579016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417232b-4673-488a-b937-5c251248097e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:54.580625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417232b-4673-488a-b937-5c251248097e None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:54.586249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 635/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Sep 19 11:04:54 2022] GET /identity/v3/role_assignments?user.id=13f59c80064f44f59abc5defb5515fd9&scope.project.id=b183d5255b80400ba5b8ab006def60cd&role.id=776f1e2ca524448593a9fae01b68a6f1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:56.764409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e99d-ed03-4180-865e-bd8d24e29ca1 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:56.764969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e99d-ed03-4180-865e-bd8d24e29ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:56.764969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012e99d-ed03-4180-865e-bd8d24e29ca1 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:56.766376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 653/1288] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:56.771883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:56.772321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:56.772425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:56.791521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:56.792795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:56.825841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:56.873742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 636/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:04:57.149749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e99d-ed03-4180-865e-bd8d24e29ca1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:57.249570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012e99d-ed03-4180-865e-bd8d24e29ca1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:57.260813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:57.284738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:57.285377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:57.285680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:57.285955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:57.286535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:57.287965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:04:57.296725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:04:57.297969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:04:57.300023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 654/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:04:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:04:57.304485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:57.400513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6516f-9752-4166-9c0c-086585e55327 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:57.433463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:57.434060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:57.434335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:57.434600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:57.435231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:57.435529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:57.436882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f3d30-ae83-478f-acc9-672ea92cd73a None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:57.442090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 637/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 19 11:04:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:57.447895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:04:57.545115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71ee0a-612b-4f8c-9b0c-dd1315837006 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:04:57.578130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:04:57.578733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:57.579017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:57.579330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] PATH_INFO: `/v3/services` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:57.579988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:04:57.580302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:04:57.581703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba43223-6aea-45f6-b7cb-411c7672e25c None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:04:57.586533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 655/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 19 11:04:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:04:59.729916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9834-7f8d-4a92-8924-41edb6b662a2 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:59.730474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9834-7f8d-4a92-8924-41edb6b662a2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:59.730474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9834-7f8d-4a92-8924-41edb6b662a2 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:59.731814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 638/1293] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:04:59.737148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe4deb-047f-4249-af8d-f01707a05d12 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:04:59.737548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe4deb-047f-4249-af8d-f01707a05d12 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:04:59.737703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe4deb-047f-4249-af8d-f01707a05d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:04:59.756183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3dbe4deb-047f-4249-af8d-f01707a05d12 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:04:59.757391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3dbe4deb-047f-4249-af8d-f01707a05d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:04:59.786773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:04:59.826135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 656/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:04:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:05:00.092719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9834-7f8d-4a92-8924-41edb6b662a2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:00.124056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:00.196192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9834-7f8d-4a92-8924-41edb6b662a2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:00.229656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:00.230252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:00.230528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:00.230798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:00.231475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:00.232837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935437de-ab7b-4b96-98da-8ae5452f0a4b None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:00.247360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 639/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Sep 19 11:05:00 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:05:02.421654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dc37-ba9c-4521-a77c-d9b09c214c14 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:02.422180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dc37-ba9c-4521-a77c-d9b09c214c14 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:02.422297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613dc37-ba9c-4521-a77c-d9b09c214c14 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:02.423601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 657/1296] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:05:02.428884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:02.429291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:02.429438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:02.448214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:05:02.449405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:05:02.522870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 640/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:05:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:05:02.792300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613dc37-ba9c-4521-a77c-d9b09c214c14 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:02.904298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613dc37-ba9c-4521-a77c-d9b09c214c14 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:02.939544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:02.940421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:02.940703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:02.940981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:02.941556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:02.942940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:05:02.951729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:05:02.952877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:02.953884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 658/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:05:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 19 11:05:02.959243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:02.977641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:03.056211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a4e0e-ea6a-459a-9275-aface1eadcc2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:03.090446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:03.091053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:03.091361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:03.091635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:03.092250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:05:03.092551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:03.093911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:03.099608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 641/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 19 11:05:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:05:03.105610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:03.136985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:03.213614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022c7f1-b598-42a3-a352-283ef140b0b7 None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:03.246173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:03.246795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:03.247072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:03.247369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:03.248050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] RBAC: Adding query filter params (interface=public, service_id=d4881f8b136a4093aefb40d85cd588f8, region_id=RegionOne) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:05:03.248353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:03.249721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011916ec-5f22-411e-9e8d-7a09df057191 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:03.254644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 659/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Sep 19 11:05:03 2022] GET /identity/v3/endpoints?service_id=d4881f8b136a4093aefb40d85cd588f8&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:05:03.260421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:03.342035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:03.360771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3de9f5-6be6-4ceb-80d6-d7f24e1d57fb None admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:03.394661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:03.395286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:03.395569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:03.395841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:03.396427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:03.397799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f8b8-b312-4428-82cd-8b5e2aae9c76 None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:03.404362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 642/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Sep 19 11:05:03 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:05:05.568454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da43e-a7b2-400d-8f5b-e0d0fd95c821 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:05.569070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da43e-a7b2-400d-8f5b-e0d0fd95c821 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:05.569070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72da43e-a7b2-400d-8f5b-e0d0fd95c821 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:05.570240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 660/1302] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:05:05.575446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:05.575870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:05.576071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:05.594201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:05:05.595624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:05:05.661169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 643/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:05:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 19 11:05:05.930697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72da43e-a7b2-400d-8f5b-e0d0fd95c821 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:06.025241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:06.032212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72da43e-a7b2-400d-8f5b-e0d0fd95c821 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:06.067226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:06.067849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:06.068123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:06.068392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:06.068956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:06.070311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 19 11:05:06.078813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 19 11:05:06.080636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.get_or_create( Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application with Lock( Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self._enter() Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application return self.creator() Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application created_value = creator( Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 19 11:05:06.081681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: ERROR keystone.server.flask.application Sep 19 11:05:06.082638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 661/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Sep 19 11:05:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 19 11:05:06.086643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:06.164191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:06.187372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7f94f-b480-4fa5-954a-e842c2332365 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:06.223122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:06.223766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:06.224038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:06.224306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] PATH_INFO: `/v3/services` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:06.224922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:05:06.225219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:06.226579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e39752-3592-475b-92e2-54c656c77e2c None admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:06.231802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 644/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Sep 19 11:05:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:05:06.238121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:05:06.343627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a7eb2-de0f-4213-85a2-745e3e1f8e7f None admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:05:06.380786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:05:06.381398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:05:06.381679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:05:06.381954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:05:06.382626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:05:06.384036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3326da-aff0-43c4-91d6-216836163691 None admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:05:06.404818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 662/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:05:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:05:16.229235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=30 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:05:16.400379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:14.419503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527997d9-7c67-41fc-aabb-7d0ecf9d16d0 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:14.419980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527997d9-7c67-41fc-aabb-7d0ecf9d16d0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:14.421016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527997d9-7c67-41fc-aabb-7d0ecf9d16d0 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:14.427756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 645/1307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:14.431961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9e4e-842c-45d7-8233-8ead310d9809 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:14.433247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9e4e-842c-45d7-8233-8ead310d9809 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:14.434060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9e4e-842c-45d7-8233-8ead310d9809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:14.568090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4f4b9e4e-842c-45d7-8233-8ead310d9809 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:14.570464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4f4b9e4e-842c-45d7-8233-8ead310d9809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:14.719221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 663/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:15.012980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:15.013644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:15.014677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:15.017088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 646/1309] 10.222.0.20 () {54 vars in 963 bytes} [Mon Sep 19 11:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:15.023363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310ea2-ff0f-4c7b-bef1-92a5a042a86c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:15.023789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310ea2-ff0f-4c7b-bef1-92a5a042a86c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:15.024175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22310ea2-ff0f-4c7b-bef1-92a5a042a86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:15.121282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-22310ea2-ff0f-4c7b-bef1-92a5a042a86c None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:15.122523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22310ea2-ff0f-4c7b-bef1-92a5a042a86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:15.148378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:15.215783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 664/1310] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Sep 19 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:15.225100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:15.227116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:15.357557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b444fc9-7579-4764-8d37-0d32cd8894db None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:15.442922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:15.444263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:15.444722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:15.445160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:15.446926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:15.511196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:15.577030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:15.578537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da616dd6-2dab-493b-bf8c-3d97e714e923 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:15.599260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 647/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:18.139397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:18.139930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:18.140295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:18.141708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 665/1312] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:18.147287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372adfb6-2643-47e8-aa0f-720bf7fa8bf1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:18.147773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372adfb6-2643-47e8-aa0f-720bf7fa8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:18.147997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372adfb6-2643-47e8-aa0f-720bf7fa8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:18.238347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-372adfb6-2643-47e8-aa0f-720bf7fa8bf1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:18.239589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-372adfb6-2643-47e8-aa0f-720bf7fa8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:18.344331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 648/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:18.636211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:18.637793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:18.752091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f12c69-41dd-43f7-b28e-2f49392c46c6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:18.829891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:18.832219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:18.833048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:18.833519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:18.833959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:18.835828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:18.961852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:18.963368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b512993-9e77-4e26-81b6-45d69777e797 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:18.983721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 666/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:21.489304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fe00-7a5a-47fc-9e3c-5291c4c0c909 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:21.489885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fe00-7a5a-47fc-9e3c-5291c4c0c909 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:21.489885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fe00-7a5a-47fc-9e3c-5291c4c0c909 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:21.491181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 649/1315] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:21.496579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b072de-ca63-47bb-906d-0022f66c6b9f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:21.497045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b072de-ca63-47bb-906d-0022f66c6b9f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:21.497153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b072de-ca63-47bb-906d-0022f66c6b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:21.563488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-86b072de-ca63-47bb-906d-0022f66c6b9f None None] MFA Rules not processed for user `59c69eba21674f358828f9d75402473e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:21.564876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-86b072de-ca63-47bb-906d-0022f66c6b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:21.616352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:21.661509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 667/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:21.966161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:21.966439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:21.966801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:21.968607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 650/1317] 10.222.0.20 () {54 vars in 963 bytes} [Mon Sep 19 11:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:21.975398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287a95-5a6d-4b83-b9ac-beb82732da70 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:21.975690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287a95-5a6d-4b83-b9ac-beb82732da70 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:21.975965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e287a95-5a6d-4b83-b9ac-beb82732da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:22.053209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5e287a95-5a6d-4b83-b9ac-beb82732da70 None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:22.054423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5e287a95-5a6d-4b83-b9ac-beb82732da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:22.131313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 668/1318] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Sep 19 11:06:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:22.140475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:22.142005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:22.151847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:22.248788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0392-eea6-4005-99fc-c19fc6ff6598 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:22.325031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:22.325636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:22.325947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:22.326218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:22.327856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:22.390347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:22.437862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:22.439604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81aef3-8cfd-417c-8ac2-3b98a372fde7 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:22.457990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 651/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:06:25.687035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:25.687675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:25.687675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:25.689300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 669/1320] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:25.694669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f65d-2b4e-44a1-8a78-f3c908c71e12 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:25.695114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f65d-2b4e-44a1-8a78-f3c908c71e12 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:25.695243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97f65d-2b4e-44a1-8a78-f3c908c71e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:25.761012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5a97f65d-2b4e-44a1-8a78-f3c908c71e12 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:25.762235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5a97f65d-2b4e-44a1-8a78-f3c908c71e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:25.859887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 652/1321] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:26.146445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:26.148022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:26.199086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:26.255576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f15605-7adb-44ef-aac8-5a497145eb08 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:26.330016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:26.330624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:26.330903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:26.331194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:26.332794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:26.431904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:26.446540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:26.448131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c45297-d6fe-4167-9485-794c8eda30ba service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:26.468737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 670/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:29.372674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:29.373325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:29.373325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:29.374570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 653/1323] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:29.379869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4829-b173-4116-9034-47b2f1aeb9d2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:29.380285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4829-b173-4116-9034-47b2f1aeb9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:29.380423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c4829-b173-4116-9034-47b2f1aeb9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:29.454790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e03c4829-b173-4116-9034-47b2f1aeb9d2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:29.456084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e03c4829-b173-4116-9034-47b2f1aeb9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:29.565436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 671/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:29.857935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:29.859409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:29.879918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:29.965852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfedf78-df2b-4e2b-9ace-8721a32d6ce6 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:30.040671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:30.041280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:30.041560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:30.041839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:30.043477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:30.119075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:30.158719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:30.160238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd8403-e170-434d-af36-caf252ec4f4f service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:30.178827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 654/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:32.434358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:32.434886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:32.435567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:32.436963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 672/1326] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:32.442830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16158020-6646-4487-9e3a-f3ccf5448332 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:32.443395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16158020-6646-4487-9e3a-f3ccf5448332 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:32.443526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16158020-6646-4487-9e3a-f3ccf5448332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:32.511868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-16158020-6646-4487-9e3a-f3ccf5448332 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:32.513068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-16158020-6646-4487-9e3a-f3ccf5448332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:32.623987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 655/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:32.908752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:32.910356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:32.973442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:33.019118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141b3fb-0f0f-4bf3-8630-9e4f7caaf3bb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:33.095561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:33.096166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:33.096439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:33.096714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:33.098322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:33.217576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:33.220316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:33.222204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a3859b-c43c-4fc5-88c6-3f470c2b5fd7 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:33.242012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 673/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:35.509749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:35.510269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:35.510269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:35.511623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 656/1329] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:35.517517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eceb-f5a0-4cdd-94a4-bd001eef0374 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:35.517926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eceb-f5a0-4cdd-94a4-bd001eef0374 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:35.518029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eceb-f5a0-4cdd-94a4-bd001eef0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:35.591019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e139eceb-f5a0-4cdd-94a4-bd001eef0374 None None] MFA Rules not processed for user `59c69eba21674f358828f9d75402473e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:35.592638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e139eceb-f5a0-4cdd-94a4-bd001eef0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:35.692593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 674/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:35.986525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:35.988144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:36.023725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:36.106516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10734196-8ed9-4d8e-b207-6048cd4050d1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:36.202721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:36.203442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:36.203756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:36.204001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:36.205900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:36.302161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:36.334502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:36.335914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2d05b-fe56-495a-985e-ef22defceb7a service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:36.355678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 657/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:38.780091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:38.780673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:38.780673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:38.781981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 675/1332] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:38.787279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f1e3-ae0d-4907-85f9-88f3a744fbc3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:38.787712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f1e3-ae0d-4907-85f9-88f3a744fbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:38.787822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357f1e3-ae0d-4907-85f9-88f3a744fbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:38.856383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6357f1e3-ae0d-4907-85f9-88f3a744fbc3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:38.858336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6357f1e3-ae0d-4907-85f9-88f3a744fbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:38.957704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 658/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:39.244034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:39.245566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:39.318091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:39.352539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885cd63-d5c8-4b95-b6f4-c6204cddc0ac None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:39.427204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:39.427816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:39.428096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:39.428369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:39.429991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:39.543788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:39.545749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2612c1f-e959-4d43-9732-19b3a157d74e service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:39.555748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:39.565336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 676/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:41.795198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:41.795793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:41.795793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:41.797123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 659/1335] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:41.802399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d81b9-2f21-4ac1-98a5-dba2ec57fab5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:41.802830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d81b9-2f21-4ac1-98a5-dba2ec57fab5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:41.802951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d81b9-2f21-4ac1-98a5-dba2ec57fab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:41.870076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-243d81b9-2f21-4ac1-98a5-dba2ec57fab5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:41.871357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-243d81b9-2f21-4ac1-98a5-dba2ec57fab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:41.971096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 677/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:42.272237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:42.273802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:42.315519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:42.379723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa4d30-83da-4658-80ce-a6e0dae093cf None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:42.455389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:42.455980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:42.456262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:42.456537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:42.458147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:42.543116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:42.570028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:42.571521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36037d51-a9d3-441b-9e09-e27ae35b8866 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:42.589763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 660/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:45.190662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:45.191416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:45.191416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:45.193052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 678/1338] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:45.198550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020199-18e9-4efd-bb17-e7a294a9d4a4 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:45.198948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020199-18e9-4efd-bb17-e7a294a9d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:45.199135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad020199-18e9-4efd-bb17-e7a294a9d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:45.266930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ad020199-18e9-4efd-bb17-e7a294a9d4a4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:45.268184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ad020199-18e9-4efd-bb17-e7a294a9d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:45.364981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 661/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:45.648213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:45.649759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:45.725891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:45.754452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524984fa-3be2-40a2-bca3-d503f3151cb4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:45.831138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:45.831781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:45.832062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:45.832341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:45.833952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:45.945605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:45.946978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30de5a5-bb86-45db-8dcd-d4a375ed5622 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:45.965062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 679/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:50.149940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:50.150471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:50.150471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:50.151849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 662/1341] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:50.157296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33073-b7ce-4950-be69-55afd1f85424 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:50.157748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33073-b7ce-4950-be69-55afd1f85424 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:50.157843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f33073-b7ce-4950-be69-55afd1f85424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:50.163809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:50.235694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a5f33073-b7ce-4950-be69-55afd1f85424 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:50.236885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a5f33073-b7ce-4950-be69-55afd1f85424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:50.355668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 680/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:50.646825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:50.648381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:50.698351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:50.756277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe868-0536-4016-aae2-58a9f462e773 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:50.835593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:50.836211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:50.836638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:50.836918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:50.838527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:50.937635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:50.956314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:50.957777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee7af-3c8a-4750-947b-6398cb06f147 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:50.976457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 663/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:53.758806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:53.759413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:53.759413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:53.760752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 681/1344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:53.766310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b73d-6d35-4594-8df0-17b9ffcd7a46 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:53.766821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b73d-6d35-4594-8df0-17b9ffcd7a46 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:53.766928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28b73d-6d35-4594-8df0-17b9ffcd7a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:53.834111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-cc28b73d-6d35-4594-8df0-17b9ffcd7a46 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:53.835384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cc28b73d-6d35-4594-8df0-17b9ffcd7a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:53.937960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 664/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:06:54.222436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:54.224007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:54.329956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:54.348854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6e2d-0573-462e-9a38-17c35de23c03 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:54.428663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:54.429267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:54.429540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:54.429807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:54.431422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:54.544355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:54.545729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798c259-2d99-455e-82d2-cfab8cda8355 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:54.564051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 682/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:06:59.014089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:59.014752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:59.014752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:59.015998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 665/1347] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:06:59.021230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5934ac-261d-4144-89c6-f7b7f889b644 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:59.021663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5934ac-261d-4144-89c6-f7b7f889b644 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:59.021837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5934ac-261d-4144-89c6-f7b7f889b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:59.038012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:59.091572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9b5934ac-261d-4144-89c6-f7b7f889b644 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:06:59.092797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9b5934ac-261d-4144-89c6-f7b7f889b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:59.193932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 683/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:06:59.479736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:06:59.481345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:59.539216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:59.585678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21f03b-13a8-4117-b1d7-6ace21cab01a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:06:59.659657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:06:59.660263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:06:59.660545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:06:59.660819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:06:59.662420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:06:59.769234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:06:59.773472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:06:59.774956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99211c7-0441-4e20-b58a-d998922b6307 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:06:59.792945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 666/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:04.763332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661997-833c-47d2-92d2-4230be38292e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:04.763792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661997-833c-47d2-92d2-4230be38292e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:04.763792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76661997-833c-47d2-92d2-4230be38292e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:04.765483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 684/1350] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:04.770898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58869b0-05f0-4829-8aab-99fa57d31dad None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:04.771407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58869b0-05f0-4829-8aab-99fa57d31dad None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:04.771505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58869b0-05f0-4829-8aab-99fa57d31dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:04.882331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-d58869b0-05f0-4829-8aab-99fa57d31dad None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:04.888490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d58869b0-05f0-4829-8aab-99fa57d31dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:05.040698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 667/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:07:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:09.192290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=59 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:09.395801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18087a3-9a63-4e04-ba05-4d0bf4cda09d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:09.396158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18087a3-9a63-4e04-ba05-4d0bf4cda09d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:09.396629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18087a3-9a63-4e04-ba05-4d0bf4cda09d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:09.397973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 685/1352] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:09.403898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260a82-9624-4669-8b93-6c043aa09f67 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:09.404387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260a82-9624-4669-8b93-6c043aa09f67 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:09.404472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260a82-9624-4669-8b93-6c043aa09f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:09.463916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:09.490670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f8260a82-9624-4669-8b93-6c043aa09f67 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:09.492075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f8260a82-9624-4669-8b93-6c043aa09f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:09.619973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 668/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:07:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:10.839130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b88ab-cc00-4e8c-95e8-70fe2690f372 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:10.840033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b88ab-cc00-4e8c-95e8-70fe2690f372 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:10.840333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b88ab-cc00-4e8c-95e8-70fe2690f372 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:10.841730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 686/1354] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:10.846988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198ff0-2672-475a-a059-58806e085269 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:10.847498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198ff0-2672-475a-a059-58806e085269 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:10.847804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1198ff0-2672-475a-a059-58806e085269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:10.929570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f1198ff0-2672-475a-a059-58806e085269 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:10.930850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f1198ff0-2672-475a-a059-58806e085269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:10.975841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:11.045615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 669/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:07:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:14.668494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83438f6b-c4dc-4f3e-9c25-0951a1704254 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:14.669562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83438f6b-c4dc-4f3e-9c25-0951a1704254 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:14.669810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83438f6b-c4dc-4f3e-9c25-0951a1704254 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:14.671439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 687/1356] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:14.677229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa231a-bafb-4330-94ac-c3b6b5af3f0d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:14.677714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa231a-bafb-4330-94ac-c3b6b5af3f0d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:14.677805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa231a-bafb-4330-94ac-c3b6b5af3f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:14.764522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-14aa231a-bafb-4330-94ac-c3b6b5af3f0d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:14.766509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-14aa231a-bafb-4330-94ac-c3b6b5af3f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:14.873151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 670/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:15.184130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:15.184625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:15.185101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:15.187248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 688/1358] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 19 11:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:15.197726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc99b-a958-4c7e-b765-c37e49b0e36e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:15.198687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc99b-a958-4c7e-b765-c37e49b0e36e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:15.199200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcc99b-a958-4c7e-b765-c37e49b0e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:15.220550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:15.312129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-96dcc99b-a958-4c7e-b765-c37e49b0e36e None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:15.313707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-96dcc99b-a958-4c7e-b765-c37e49b0e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:15.447973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 671/1359] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 19 11:07:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:07:15.457833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:15.459523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:15.623780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734b93f-b4ac-4c64-9027-3854e3f0d91e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:15.704813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:15.749326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:15.749939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:15.750233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:15.750492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:15.752274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:15.858807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:15.860477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19cd9aa-ea0c-4870-8465-b59dfb7dc014 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:15.890650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 689/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:07:18.319133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839611-075c-481f-a76e-550aad0055e3 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:18.319632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839611-075c-481f-a76e-550aad0055e3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:18.320338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839611-075c-481f-a76e-550aad0055e3 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:18.322297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 672/1361] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:18.328572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512168-c404-49bd-8821-711df340f98a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:18.329068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512168-c404-49bd-8821-711df340f98a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:18.329183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512168-c404-49bd-8821-711df340f98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:18.405770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-88512168-c404-49bd-8821-711df340f98a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:18.406686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-88512168-c404-49bd-8821-711df340f98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:18.451792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:18.531231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 690/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:18.825937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af839611-075c-481f-a76e-550aad0055e3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:18.829122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-af839611-075c-481f-a76e-550aad0055e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:18.920849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:19.041005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af839611-075c-481f-a76e-550aad0055e3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:19.175913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17193de-287b-46af-a144-684b4840e315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:19.176426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17193de-287b-46af-a144-684b4840e315 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:19.176708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17193de-287b-46af-a144-684b4840e315 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:19.176981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17193de-287b-46af-a144-684b4840e315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:19.178609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c17193de-287b-46af-a144-684b4840e315 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:19.204214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:19.296092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17193de-287b-46af-a144-684b4840e315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:19.297734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17193de-287b-46af-a144-684b4840e315 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:19.319352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 673/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:21.867234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add5bf-422b-4bfc-b4ab-82989aa5e68b None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:21.868581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add5bf-422b-4bfc-b4ab-82989aa5e68b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:21.868581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62add5bf-422b-4bfc-b4ab-82989aa5e68b None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:21.869752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 691/1364] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:21.875701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35eb10-52af-44d0-8032-a401820f52d9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:21.876168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35eb10-52af-44d0-8032-a401820f52d9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:21.876266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35eb10-52af-44d0-8032-a401820f52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:21.960614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6a35eb10-52af-44d0-8032-a401820f52d9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:21.961848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6a35eb10-52af-44d0-8032-a401820f52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:22.070254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:22.072737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 674/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:22.362474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:22.362758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:22.363057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:22.364601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 692/1366] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 19 11:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:22.370092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4978-5c68-4a95-946b-43e1c7e4c7a6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:22.370385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4978-5c68-4a95-946b-43e1c7e4c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:22.370679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd4978-5c68-4a95-946b-43e1c7e4c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:22.454358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c4bd4978-5c68-4a95-946b-43e1c7e4c7a6 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:22.455634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c4bd4978-5c68-4a95-946b-43e1c7e4c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:22.582396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 675/1367] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 19 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:22.590717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:22.592379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:22.757116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9af01-9d9c-4cfd-b186-3c0e7848e3e0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:22.781227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:22.882902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:22.883649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:22.883893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:22.884123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:22.885726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:23.001911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:23.003912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078662ce-12bb-4be5-921a-2c7d1bbc8f7b service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:23.024921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 693/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:23.051959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699925d-aeaa-44af-bb06-243ede4c53e8 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:23.052615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699925d-aeaa-44af-bb06-243ede4c53e8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:23.052615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699925d-aeaa-44af-bb06-243ede4c53e8 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:23.053857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 676/1369] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:23.060561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f10b1-b877-4399-9ff3-7f68aacc2172 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:23.060792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f10b1-b877-4399-9ff3-7f68aacc2172 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:23.061168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f10b1-b877-4399-9ff3-7f68aacc2172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:23.099700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:23.152223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e63f10b1-b877-4399-9ff3-7f68aacc2172 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:23.153965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e63f10b1-b877-4399-9ff3-7f68aacc2172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:23.291820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 694/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:23.632532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:23.632924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:23.633324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:23.634934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 677/1371] 10.222.0.20 () {54 vars in 967 bytes} [Mon Sep 19 11:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:23.641139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8487b2-a848-4dbc-8e54-78c4bac79843 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:23.641493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8487b2-a848-4dbc-8e54-78c4bac79843 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:23.641761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8487b2-a848-4dbc-8e54-78c4bac79843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:23.724456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fd8487b2-a848-4dbc-8e54-78c4bac79843 None None] MFA Rules not processed for user `7968f762514f42df8264f5cbd1eb37ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:23.725673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fd8487b2-a848-4dbc-8e54-78c4bac79843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:23.776953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:23.819194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 695/1372] 10.222.0.20 () {58 vars in 1064 bytes} [Mon Sep 19 11:07:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:23.820387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:23.822176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:23.878824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:23.948180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b495a-8201-4bed-8a95-4a12a7e0c249 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:24.050566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:24.051741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:24.052020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:24.053069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:24.054725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:24.176484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:24.190843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:24.192233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc9d84-caa6-4618-89f7-08282f7fa048 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:24.214975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 678/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:25.397249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:25.397841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:25.397990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:25.399401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 696/1374] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:25.406138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fc74-fb6a-4983-b09a-6fa021104992 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:25.406628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fc74-fb6a-4983-b09a-6fa021104992 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:25.406745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fc74-fb6a-4983-b09a-6fa021104992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:25.484744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-b420fc74-fb6a-4983-b09a-6fa021104992 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:25.485996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b420fc74-fb6a-4983-b09a-6fa021104992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:25.595641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 679/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:25.909473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:25.911019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:26.105887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b879-f041-46fc-8de3-67c6c082e3c5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:26.167388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:26.249157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:26.249768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:26.250041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:26.250307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:26.252674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:26.358701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:26.360393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9650b18-b575-45a3-85f4-a59f86e1dcb2 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:26.381311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 697/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:07:28.614282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:28.614864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:28.614864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:28.616282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 680/1377] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:28.622051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa535-2f17-4877-802c-7bb4f4f59841 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:28.623323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa535-2f17-4877-802c-7bb4f4f59841 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:28.623323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20aa535-2f17-4877-802c-7bb4f4f59841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:28.705770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d20aa535-2f17-4877-802c-7bb4f4f59841 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:28.707427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d20aa535-2f17-4877-802c-7bb4f4f59841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:28.714921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:28.831289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 698/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:29.119408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:29.121320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:29.186412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:29.281900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc068f-b577-4ee4-8dfd-509de105efa8 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:29.407193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:29.407812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:29.408101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:29.408370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:29.409958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:29.430933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:29.512749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:29.514387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82618c02-6553-4190-9dca-0418348cc073 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:29.534570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 681/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:31.768347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:31.769977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:31.769977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:31.775823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb39309-2c4d-4738-bccb-2e5c70c4bfa4 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:31.775823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb39309-2c4d-4738-bccb-2e5c70c4bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:31.776564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb39309-2c4d-4738-bccb-2e5c70c4bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:31.780935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 699/1380] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:31.848733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2fb39309-2c4d-4738-bccb-2e5c70c4bfa4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:31.849847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2fb39309-2c4d-4738-bccb-2e5c70c4bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:31.963674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:31.970346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 682/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:07:32.269259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:32.270871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:32.430781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:32.443048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e477b-f7a5-4081-bf50-4a6cf82a45d0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:32.583924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:32.584460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:32.584737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:32.585008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:32.586648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:32.679221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:32.680902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f7ded-010b-4f48-b53f-9ce05853e0b3 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:32.692106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:32.701456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 700/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:34.986913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:34.987539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:34.987539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:34.988933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 683/1383] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:34.995635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87dba-5ddd-4a3f-b49a-67a63c6bdeed None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:34.996177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87dba-5ddd-4a3f-b49a-67a63c6bdeed None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:34.996177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87dba-5ddd-4a3f-b49a-67a63c6bdeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:35.080817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d6c87dba-5ddd-4a3f-b49a-67a63c6bdeed None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:35.082663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d6c87dba-5ddd-4a3f-b49a-67a63c6bdeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:35.213495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 701/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:35.580763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:35.582690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:35.773429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb3447-41fc-4cbd-a70b-d66e0b8ad6de None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:35.851255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:35.916035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:35.916761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:35.917011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:35.917400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:35.919784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:36.036462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:36.038282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68c675-6c24-4f4d-9a8e-0bf201216ba2 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:36.063752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 684/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:38.411318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:38.411318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:38.411318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:38.412724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 702/1386] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:38.418429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be2ed-e12e-4dac-b2d9-0ef107dfde31 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:38.419022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be2ed-e12e-4dac-b2d9-0ef107dfde31 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:38.420024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6be2ed-e12e-4dac-b2d9-0ef107dfde31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:38.489381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8a6be2ed-e12e-4dac-b2d9-0ef107dfde31 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:38.490542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8a6be2ed-e12e-4dac-b2d9-0ef107dfde31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:38.524508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:38.590466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 685/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:38.896479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:38.898027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:38.980012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:39.167836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f447b-ff5c-4248-8837-8ea4d6b87503 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:39.288326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:39.288941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:39.289220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:39.289492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:39.291113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:39.331534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:39.384973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:39.386703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04333e35-c2f0-4b80-8d44-bd9b4c2d2586 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:39.405621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 703/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:39.712323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b886f4-51ac-4365-ad3d-fc2d8ef94d74 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:39.712841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b886f4-51ac-4365-ad3d-fc2d8ef94d74 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:39.712841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b886f4-51ac-4365-ad3d-fc2d8ef94d74 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:39.714096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 686/1389] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:39.720131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402031-f538-4de3-8e7c-3503538aa60e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:39.720628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402031-f538-4de3-8e7c-3503538aa60e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:39.720728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92402031-f538-4de3-8e7c-3503538aa60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:39.789670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-92402031-f538-4de3-8e7c-3503538aa60e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:39.790906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-92402031-f538-4de3-8e7c-3503538aa60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:39.891093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 704/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:40.197557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:40.197845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:40.198128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:40.199531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 687/1391] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 19 11:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:40.205095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029422a3-3c70-4278-b172-b9c736e906f0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:40.205388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029422a3-3c70-4278-b172-b9c736e906f0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:40.205666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029422a3-3c70-4278-b172-b9c736e906f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:40.225426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:40.292328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-029422a3-3c70-4278-b172-b9c736e906f0 None None] MFA Rules not processed for user `12546450f8af46a3816cd8e75e9d3ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:40.293545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-029422a3-3c70-4278-b172-b9c736e906f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:40.377619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 705/1392] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 19 11:07:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:40.386745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:40.388850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:40.494856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacb452-fc65-48a1-8954-4c41c1ba6a39 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:40.560359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:40.576929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:40.577541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:40.577819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:40.578089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:40.579735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:40.691668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:40.693123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167c2d5-f1d4-4248-99be-1ac37c5189be service glance] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:40.712364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 688/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:41.466395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deaae8-46f4-4e6e-956c-2b9c3f4d04f3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:41.466914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deaae8-46f4-4e6e-956c-2b9c3f4d04f3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:41.467417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deaae8-46f4-4e6e-956c-2b9c3f4d04f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:41.540064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-04deaae8-46f4-4e6e-956c-2b9c3f4d04f3 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:41.541298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-04deaae8-46f4-4e6e-956c-2b9c3f4d04f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:41.598099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:41.631075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 706/1394] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:07:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:41.642501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae0a6-edb4-4a4b-8057-f8f72aadc91d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:41.642791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae0a6-edb4-4a4b-8057-f8f72aadc91d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:41.643066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ae0a6-edb4-4a4b-8057-f8f72aadc91d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:41.644461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 689/1395] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:41.651916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:41.652321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:41.652689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:41.678385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ef66e-3916-4c7b-b20c-4ce356c0e6e7 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:41.678761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ef66e-3916-4c7b-b20c-4ce356c0e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:41.679110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ef66e-3916-4c7b-b20c-4ce356c0e6e7 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:41.680483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 690/1396] 10.222.0.20 () {54 vars in 943 bytes} [Mon Sep 19 11:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:07:41.687284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:41.687573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:41.687910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:41.725832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:41.726967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:41.771446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] MFA Rules not processed for user `a0a463d7f5db49fe9de8bb390363ba5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:41.772653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:41.806538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:41.830367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 707/1397] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:07:41.884433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 691/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Mon Sep 19 11:07:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:07:41.903232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:41.904856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:41.968213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:42.020581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0064-b5be-4212-9781-2d4e71af8a40 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:42.124272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:42.125559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:42.127083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:42.127718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:42.127991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:42.128261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:42.129868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:42.202397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:42.219095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:42.220969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537be69-96dd-4a6b-8218-5f816a4e3ab2 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:42.228359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a35c8-9d54-4d8e-bdcc-851bdb375ba2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:42.229081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 708/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:07:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:07:42.289820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:42.366701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:42.367380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:42.367901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:42.368296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:42.370098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:42.477914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:42.479589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc99b8-9164-482b-9604-4a094d4bd1d1 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:42.500707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 692/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:07:44.759758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:44.760339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:44.760339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:44.761678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 709/1401] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:44.768201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa497b3-51a7-460b-9924-972b9191944c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:44.768693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa497b3-51a7-460b-9924-972b9191944c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:44.768693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa497b3-51a7-460b-9924-972b9191944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:44.844922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2aa497b3-51a7-460b-9924-972b9191944c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:44.846150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2aa497b3-51a7-460b-9924-972b9191944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:44.857908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:44.971353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 693/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:45.261923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:45.263821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:45.445077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44fbe33-3de3-487f-921b-e362c3cf2e43 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:45.517823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:45.584860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:45.585613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:45.585901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:45.586175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:45.587838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:45.694753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:45.696431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba23e7-3dea-4867-9fd0-fefe4a8be831 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:45.716701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 710/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:48.027890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:48.028624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:48.028624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:48.029906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 694/1404] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:48.036413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ded2-3118-4f36-a62a-e2400b2191e1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:48.037310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ded2-3118-4f36-a62a-e2400b2191e1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:48.037761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8ded2-3118-4f36-a62a-e2400b2191e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:48.119614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-04f8ded2-3118-4f36-a62a-e2400b2191e1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:48.121061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-04f8ded2-3118-4f36-a62a-e2400b2191e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:48.141224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:48.237901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 711/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:48.539890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:48.541543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:48.719640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:48.732586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa125d-dc69-4a33-bb4b-cfded80a7596 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:48.880986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:48.881526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:48.881803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:48.882063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:48.884220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:49.011617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:49.015709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daf7dd-0c86-4193-80e0-e9d3315c4148 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:49.053874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:49.067496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 695/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:07:51.394405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:51.394405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:51.394405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:51.396085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 712/1407] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:07:51.401583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3c36-a660-44bd-8fbe-10259743d69e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:51.402079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3c36-a660-44bd-8fbe-10259743d69e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:51.402194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff3c36-a660-44bd-8fbe-10259743d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:51.486691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ceff3c36-a660-44bd-8fbe-10259743d69e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:07:51.489178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ceff3c36-a660-44bd-8fbe-10259743d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:51.608562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 696/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:07:51.910797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:07:51.912375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:52.090425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd909a31-4c42-4eba-a9c7-12499fbd63f2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:07:52.093777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:07:52.224668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:07:52.227251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:07:52.227547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:07:52.227806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:07:52.229469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:07:52.339976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:07:52.341815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ef671-07e3-4665-95df-91f8336de836 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:07:52.377908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 713/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:01.607298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=66 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:02.362385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:05.643710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e57b-d1aa-4a72-a6e1-fd9d908cf6e2 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:05.644283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e57b-d1aa-4a72-a6e1-fd9d908cf6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:05.644283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0e57b-d1aa-4a72-a6e1-fd9d908cf6e2 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:05.645689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 697/1410] 10.222.0.20 () {54 vars in 918 bytes} [Mon Sep 19 11:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:08:05.651603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e7bc-d4df-4dc0-b804-1592af8cf2f9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:05.652313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e7bc-d4df-4dc0-b804-1592af8cf2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:05.652313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6e7bc-d4df-4dc0-b804-1592af8cf2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:05.750488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f0b6e7bc-d4df-4dc0-b804-1592af8cf2f9 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:05.751773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f0b6e7bc-d4df-4dc0-b804-1592af8cf2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:05.879099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 714/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Sep 19 11:08:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:05.896426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8f51-54e9-4084-b468-fc67d4fd4d56 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:05.896645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8f51-54e9-4084-b468-fc67d4fd4d56 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:05.896982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f8f51-54e9-4084-b468-fc67d4fd4d56 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:05.898371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 698/1412] 10.222.0.20 () {54 vars in 918 bytes} [Mon Sep 19 11:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:05.904216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44f52-4dff-4fb1-925b-836a3462e670 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:05.905038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44f52-4dff-4fb1-925b-836a3462e670 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:05.905355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44f52-4dff-4fb1-925b-836a3462e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:05.989229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:05.992198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d9b44f52-4dff-4fb1-925b-836a3462e670 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:05.994243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d9b44f52-4dff-4fb1-925b-836a3462e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:06.126389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 715/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Sep 19 11:08:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:08.817245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:08.818073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:08.818073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:08.819549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:08.825242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbef7f-a77c-49be-a8a9-1bee0794db4c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:08.826265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbef7f-a77c-49be-a8a9-1bee0794db4c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:08.826408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbef7f-a77c-49be-a8a9-1bee0794db4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:08.897799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a9fbef7f-a77c-49be-a8a9-1bee0794db4c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:08.899064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a9fbef7f-a77c-49be-a8a9-1bee0794db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:08.962497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:09.007036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:09.301484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:09.303023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:09.484193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc6dcd-4de0-40cb-b056-84165076caf0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:09.582776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:09.628520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:09.629440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:09.629823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:09.630099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:09.632192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:09.741680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:09.743879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b202f4a-80ff-45b2-8a83-bf5387978176 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:09.767888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 700/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:10.966402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:10.967304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:10.967525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:10.968883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:10.976839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036a13-6c77-47f5-9d60-4dd7f4157d62 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:10.977383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036a13-6c77-47f5-9d60-4dd7f4157d62 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:10.977383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87036a13-6c77-47f5-9d60-4dd7f4157d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:11.069151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-87036a13-6c77-47f5-9d60-4dd7f4157d62 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:11.070380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-87036a13-6c77-47f5-9d60-4dd7f4157d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:11.099641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:11.191917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:11.345984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:11.347551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:11.527020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3e65-cf00-4017-97b3-c569e1d4867d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:11.576517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:11.657524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:11.658134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:11.658409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:11.658675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:11.660341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:11.763060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:11.765800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b13c08-c4d5-4dab-b36b-90790fd8de30 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:11.787474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 718/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:13.015562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:13.016162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:13.016162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:13.017491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:08:13.024525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c89f60-e34c-4b8c-a4bb-312bb6e326ee None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:13.025058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c89f60-e34c-4b8c-a4bb-312bb6e326ee None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:13.025058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c89f60-e34c-4b8c-a4bb-312bb6e326ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:13.083015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:13.108090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-94c89f60-e34c-4b8c-a4bb-312bb6e326ee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:13.109343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-94c89f60-e34c-4b8c-a4bb-312bb6e326ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:13.217961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:13.369197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:13.370733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:13.532710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287acb-b2ec-412b-aa8d-d07fbd2dc744 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:13.545757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:13.652244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:13.652859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:13.653136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:13.653403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:13.656011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:13.758091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:13.759785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162c828-7fd6-4a71-b772-115042f85fdb service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:13.782327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 703/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:14.938633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:14.939206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:14.939206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:14.940465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:14.947137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9585-145c-4792-aea6-e0f654138638 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:14.947624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9585-145c-4792-aea6-e0f654138638 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:14.947782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d9585-145c-4792-aea6-e0f654138638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:14.967450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:15.026087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ac1d9585-145c-4792-aea6-e0f654138638 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:15.027326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ac1d9585-145c-4792-aea6-e0f654138638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:15.126953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:15.278404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:15.280066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:15.394265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:15.429723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64124-d234-4e4a-9938-79ad855c6928 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:15.554498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:15.555014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:15.555327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:15.555604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:15.557251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:15.643590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:15.658565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:15.660224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122b504-3ab1-4a77-a398-f3b7cd0f90c4 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:15.680006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 721/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:16.813929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:16.814624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:16.814624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:16.815865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:16.824380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3fc-fcf2-4e0f-94d6-99981f66bc33 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:16.824946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3fc-fcf2-4e0f-94d6-99981f66bc33 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:16.824946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3fc-fcf2-4e0f-94d6-99981f66bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:16.906766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-261af3fc-fcf2-4e0f-94d6-99981f66bc33 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:16.908072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-261af3fc-fcf2-4e0f-94d6-99981f66bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:17.006126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:17.156607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:17.158136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:17.267540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:17.340733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa786-926e-46f4-962e-df4bc281d840 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:17.459683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:17.460192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:17.460464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:17.460729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:17.462304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:17.512709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:17.557018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:17.558638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561abb9-dc20-4b06-b7c2-f9c8f19fb73a service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:17.576824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 706/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:18.659562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:18.660163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:18.660163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:18.661518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:18.668163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efb77-2e98-4857-b35f-1da2553fee85 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:18.668674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efb77-2e98-4857-b35f-1da2553fee85 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:18.668878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efb77-2e98-4857-b35f-1da2553fee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:18.752949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-340efb77-2e98-4857-b35f-1da2553fee85 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:18.754165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-340efb77-2e98-4857-b35f-1da2553fee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:18.860757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:08:19.013366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:19.015719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:19.067867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:19.170582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d534c4-a97b-4edd-8997-791aa99f53e7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:19.297644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:19.298254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:19.298534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:19.298857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:19.300508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:19.307718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:19.392474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:19.394091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33197d1c-b6a1-430c-b9fd-70d5788bf435 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:19.412372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 724/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:20.485903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:20.486545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:20.486921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:20.489552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:20.496641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dd13e-efcb-4df7-940a-0bded18102b2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:20.497158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dd13e-efcb-4df7-940a-0bded18102b2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:20.497289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4dd13e-efcb-4df7-940a-0bded18102b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:20.583689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2d4dd13e-efcb-4df7-940a-0bded18102b2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:20.584832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2d4dd13e-efcb-4df7-940a-0bded18102b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:20.659629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:20.694678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:20.853517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:20.855117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:20.875359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:21.017564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da1a2-ec66-4304-9d6d-e5b18151621d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:21.109455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:21.136817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:21.137430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:21.137711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:21.137983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:21.139827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:21.244086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:21.245710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ee7fb-49f3-44c9-829d-a4c04838fe4a service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:21.265666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 709/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:22.378815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:22.379461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:22.379461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:22.380785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:22.388909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b70ee-747e-4d6f-a354-bbd3c6e8783f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:22.389477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b70ee-747e-4d6f-a354-bbd3c6e8783f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:22.389584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b70ee-747e-4d6f-a354-bbd3c6e8783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:22.495520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-d60b70ee-747e-4d6f-a354-bbd3c6e8783f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:22.497628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d60b70ee-747e-4d6f-a354-bbd3c6e8783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:22.546402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:22.612922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:22.768146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:22.769706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:22.937473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55854130-710c-4903-9fe0-af41e39ac066 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:22.994574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:23.057294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:23.057907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:23.058180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:23.058458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:23.060213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:23.153081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:23.154775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea4c11-60e8-47dc-9640-ae66bb225193 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:23.173797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 727/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:24.270653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:24.271200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:24.271200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:24.272478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:24.279987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee82-0cc1-429c-a63e-fdca3420aeb7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:24.280550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee82-0cc1-429c-a63e-fdca3420aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:24.280550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee82-0cc1-429c-a63e-fdca3420aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:24.365528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ebcaee82-0cc1-429c-a63e-fdca3420aeb7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:24.367644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ebcaee82-0cc1-429c-a63e-fdca3420aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:24.370378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:24.474562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:24.626422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:24.629125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:24.777134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f87f-7413-4ba3-9494-c4d160cb7cd9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:24.804538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:24.893019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:24.893630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:24.893919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:24.894190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:24.895854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:24.992700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:24.994318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad0c62-8318-449a-9d93-352a9f365b2d service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:25.012900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 712/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:27.148059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:27.148606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:27.148606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:27.149964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:27.156282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e80c-5ecc-4e18-9b8a-b597400d664a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:27.156746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e80c-5ecc-4e18-9b8a-b597400d664a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:27.156852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e80c-5ecc-4e18-9b8a-b597400d664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:27.199523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:27.225860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6d31e80c-5ecc-4e18-9b8a-b597400d664a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:27.227085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6d31e80c-5ecc-4e18-9b8a-b597400d664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:27.326442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:27.613350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:27.614905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:27.721297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdd5d4-1f8f-4ddb-a555-1dd0686fe2d4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:27.754432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:27.805459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:27.806079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:27.806345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:27.806619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:27.808292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:27.920085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:27.921566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00486b35-3a2f-4fe4-a014-5ca3c8e38c54 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:27.940854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 730/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:30.299870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:30.300328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:30.300439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:30.301762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:30.307029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a328-521e-46e2-a31b-eb202c7dfa90 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:30.307561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a328-521e-46e2-a31b-eb202c7dfa90 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:30.307672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654a328-521e-46e2-a31b-eb202c7dfa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:30.375866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6654a328-521e-46e2-a31b-eb202c7dfa90 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:30.377072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6654a328-521e-46e2-a31b-eb202c7dfa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:30.390574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:30.479184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:30.772543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:30.774186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:30.883309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da8e1c-e983-445e-857d-db191a6c1d08 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:30.897154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:30.962222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:30.962863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:30.963144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:30.963446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:30.965106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:31.076808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:31.078414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b544c-a9f8-4550-b889-3c15614408b7 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:31.097919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 715/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:33.652125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:33.652653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:33.652653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:33.654147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:33.659745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383807-9516-4096-b038-b111de55521f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:33.660195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383807-9516-4096-b038-b111de55521f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:33.660333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04383807-9516-4096-b038-b111de55521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:33.709181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:33.727854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-04383807-9516-4096-b038-b111de55521f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:33.729137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-04383807-9516-4096-b038-b111de55521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:33.828415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:34.116718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:34.118263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:34.222458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006147-d96b-4bec-8802-4c2472ba0e22 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:34.265136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:34.300876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:34.301481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:34.301760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:34.302031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:34.303646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:34.415954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:34.417421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ff86d-f419-4c8a-9916-33ac97408b27 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:34.435943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 733/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:36.783131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:36.783692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:36.783692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:36.785046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:36.790343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f544cf-198b-49b6-8895-be849542292f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:36.790761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f544cf-198b-49b6-8895-be849542292f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:36.790903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f544cf-198b-49b6-8895-be849542292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:36.860576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c5f544cf-198b-49b6-8895-be849542292f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:36.861791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c5f544cf-198b-49b6-8895-be849542292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:36.882879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:36.968946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:37.250390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:37.251965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:37.358332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d295d19-a52b-4418-8299-a70c413c1704 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:37.380239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:37.434431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:37.435037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:37.436002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:37.436249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:37.437861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:37.551249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:37.552613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535643ee-683f-4500-bad8-af339f8d1130 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:37.571292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 718/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:39.864550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:39.865129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:39.865129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:39.866450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:39.871966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5944-1d0f-4953-9d16-6d5df4a54a3e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:39.872419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5944-1d0f-4953-9d16-6d5df4a54a3e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:39.872539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5944-1d0f-4953-9d16-6d5df4a54a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:39.939638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:39.942540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-281b5944-1d0f-4953-9d16-6d5df4a54a3e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:39.944706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-281b5944-1d0f-4953-9d16-6d5df4a54a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:40.040559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:40.328730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:40.330285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:40.436449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e200e19-f8f0-44da-9d5a-8ff90e7334df None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:40.492017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:40.520567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:40.521174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:40.521452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:40.521720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:40.523355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:40.637460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:40.639360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120eeae8-dde9-4b5f-ab38-2de32cfcee09 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:40.657732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 736/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:42.905732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:42.906319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:42.906319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:42.907729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:42.913299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa34f-a6d2-417b-a066-4e247658838c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:42.913753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa34f-a6d2-417b-a066-4e247658838c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:42.913847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfa34f-a6d2-417b-a066-4e247658838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:42.982465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-69bfa34f-a6d2-417b-a066-4e247658838c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:42.983881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-69bfa34f-a6d2-417b-a066-4e247658838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:43.012788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:43.088504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:43.377314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:43.378863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:43.505814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce975fc-073c-430e-ad52-fba917c8b2cb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:43.534478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:43.581660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:43.582177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:43.582454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:43.582731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:43.584359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:43.695440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:43.696899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081479d1-b0c3-469d-8048-d16af7afb111 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:43.716300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 721/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:45.953430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:45.953930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:45.954029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:45.955364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:45.960789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c50dd-f473-49cd-bd37-2d4b277d083b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:45.961229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c50dd-f473-49cd-bd37-2d4b277d083b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:45.961325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c50dd-f473-49cd-bd37-2d4b277d083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:46.029940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f98c50dd-f473-49cd-bd37-2d4b277d083b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:46.031186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f98c50dd-f473-49cd-bd37-2d4b277d083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:46.039772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:46.130620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:46.417859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:46.419498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:46.529264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97435ef-7dee-4723-b449-3671559b4383 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:46.587904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:46.606789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:46.608035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:46.608499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:46.608787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:46.610371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:46.722545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:46.724053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a753b56-5927-4ce3-b758-92dddeb31e82 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:46.743061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 739/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:48.960216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:48.960842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:48.960842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:48.962157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:48.968221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b365f-4a1e-4bc1-9d0b-dc569c748e1f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:48.968669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b365f-4a1e-4bc1-9d0b-dc569c748e1f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:48.968778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b365f-4a1e-4bc1-9d0b-dc569c748e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:49.034491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-844b365f-4a1e-4bc1-9d0b-dc569c748e1f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:49.035721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-844b365f-4a1e-4bc1-9d0b-dc569c748e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:49.076940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:49.135730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:49.429498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:49.431086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:49.539620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8b60d-2707-4329-a97e-fbe95b871c54 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:49.578339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:49.614993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:49.615624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:49.615900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:49.616170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:49.617754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:49.728791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:49.730241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0072e-46f2-4059-a355-40407d79ca49 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:49.748792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 724/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:51.939606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:51.940217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:51.940217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:51.941504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:51.947864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286eb8-3094-4646-a85e-93f3a3642624 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:51.948430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286eb8-3094-4646-a85e-93f3a3642624 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:51.948598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3286eb8-3094-4646-a85e-93f3a3642624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:52.018467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e3286eb8-3094-4646-a85e-93f3a3642624 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:52.019786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e3286eb8-3094-4646-a85e-93f3a3642624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:52.038832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:52.239528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:52.527067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:52.528742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:52.633458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df6cb1-8050-4b8f-930a-c02ccf36fa93 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:52.702083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:52.709536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:52.710178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:52.710458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:52.710731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:52.712367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:52.821912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:52.823381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854da513-6531-4258-94d3-4b2a660a3ea1 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:52.842356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 742/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:08:55.051983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:55.052558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:55.052558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:55.053866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:08:55.059508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a098-63be-446f-b913-81fb1f2bad43 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:55.059934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a098-63be-446f-b913-81fb1f2bad43 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:55.060091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a098-63be-446f-b913-81fb1f2bad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:55.126125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-59f9a098-63be-446f-b913-81fb1f2bad43 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:08:55.127365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-59f9a098-63be-446f-b913-81fb1f2bad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:55.177613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:55.227448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:08:55.516547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:08:55.518084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:55.622671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861698-0a9b-4fae-a4fd-9666c0f063d0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:08:55.672575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:08:55.699482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:08:55.700087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:08:55.700364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:08:55.700634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:08:55.702888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:08:55.811887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:08:55.813455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f74c5-e159-4a52-a191-c7eb58096296 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:08:55.833247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 727/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:05.225868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=22 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:05.830310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=66 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:16.051410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2789-f5d4-4eaa-b77c-63567ca44054 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:16.051971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2789-f5d4-4eaa-b77c-63567ca44054 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:16.051971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b2789-f5d4-4eaa-b77c-63567ca44054 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:16.053285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 744/1471] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:16.058682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf55b4-1c52-4e6f-84b5-1fa98acb159f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:16.059142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf55b4-1c52-4e6f-84b5-1fa98acb159f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:16.059286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf55b4-1c52-4e6f-84b5-1fa98acb159f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:16.126654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-08cf55b4-1c52-4e6f-84b5-1fa98acb159f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:16.127905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-08cf55b4-1c52-4e6f-84b5-1fa98acb159f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:16.233443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 728/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:16.535416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:16.535698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:16.535977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:16.537545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 745/1473] 10.222.0.20 () {54 vars in 962 bytes} [Mon Sep 19 11:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:16.542777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68a443-9786-48e3-aea7-ea59774fc9f2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:16.543057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68a443-9786-48e3-aea7-ea59774fc9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:16.543358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68a443-9786-48e3-aea7-ea59774fc9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:16.624476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2e68a443-9786-48e3-aea7-ea59774fc9f2 None None] MFA Rules not processed for user `12546450f8af46a3816cd8e75e9d3ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:16.625633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2e68a443-9786-48e3-aea7-ea59774fc9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:16.646329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:16.701845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 729/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Sep 19 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:16.709521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:16.711047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:16.816575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce8653-933d-42af-b76e-5258c4c2e3eb None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:16.890562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:16.891189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:16.891474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:16.891750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:16.893354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:16.954748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:17.013289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:17.015314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c46438-b9e0-475b-b78b-28f6d20d3927 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:17.034457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 746/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:19.305922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:19.306536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:19.306536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:19.307855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 730/1476] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:19.314457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be80b2-18d4-49e9-9bd0-9f195153f278 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:19.315331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be80b2-18d4-49e9-9bd0-9f195153f278 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:19.315515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be80b2-18d4-49e9-9bd0-9f195153f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:19.385997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-02be80b2-18d4-49e9-9bd0-9f195153f278 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:19.387250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-02be80b2-18d4-49e9-9bd0-9f195153f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:19.484741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 747/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:19.761728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:19.763286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:19.890347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796600-3776-4e30-9220-ed2037e152c2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:19.943633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:19.988129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:19.988746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:19.989028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:19.989304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:19.989936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:19.991721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:09:19.991721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:09:19.991721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:09:19.992863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378612eb-4b05-4fc1-a223-63d6c550cb29 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:20.012512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 731/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Sep 19 11:09:19 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:09:22.223022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:22.223587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:22.223587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:22.224858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 748/1479] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:22.230585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626067-7a7c-4fc2-8223-ee60f4ded58d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:22.231091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626067-7a7c-4fc2-8223-ee60f4ded58d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:22.231231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626067-7a7c-4fc2-8223-ee60f4ded58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:22.303448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-12626067-7a7c-4fc2-8223-ee60f4ded58d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:22.304680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-12626067-7a7c-4fc2-8223-ee60f4ded58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:22.407573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 732/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:22.707780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:22.710406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:22.721397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:22.859882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e0de-2882-4f8e-9b19-88feadfe587d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:22.941638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:22.977624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:22.978146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:22.978428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:22.978704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:22.980360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:23.073581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:23.075214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a1b03-f118-4509-aee9-f80db06f9c1d service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:23.093767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 749/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:25.596327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:25.596869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:25.596869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:25.598098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 733/1482] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:25.604201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f20-2312-4034-a0b2-8d8424598ec3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:25.605018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f20-2312-4034-a0b2-8d8424598ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:25.605204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f20-2312-4034-a0b2-8d8424598ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:25.682541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-32a31f20-2312-4034-a0b2-8d8424598ec3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:25.683839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-32a31f20-2312-4034-a0b2-8d8424598ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:25.746252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:25.802053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 750/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:26.090114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:26.091752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:26.116076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:26.199558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b83050-1dda-4154-a909-f3db099d6b95 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:26.277186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:26.277802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:26.278077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:26.278345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:26.280150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:26.356942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:26.394113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:26.395607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb27351-e686-4f3c-9e7f-e9e36ea4681a service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:26.413976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 734/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:28.671772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:28.672322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:28.672322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:28.673711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 751/1485] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:28.678981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e4a6-7349-4310-96ca-3102c1c306c2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:28.679418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e4a6-7349-4310-96ca-3102c1c306c2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:28.679560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8e4a6-7349-4310-96ca-3102c1c306c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:28.747144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-67a8e4a6-7349-4310-96ca-3102c1c306c2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:28.748909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-67a8e4a6-7349-4310-96ca-3102c1c306c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:28.846044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 735/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:29.138013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:29.140327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:29.243501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318098-20a2-4987-8fd0-097be4acf728 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:29.317509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:29.319068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:29.319717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:29.320198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:29.320641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:29.322673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:29.432737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:29.434211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b08c2-de2a-4dd6-94da-0c63060e9e03 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:29.452864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 752/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:31.809408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:31.809984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:31.809984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:31.811341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 736/1488] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:31.816754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2774d-2d2b-4419-a22d-2fd9e388428c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:31.817241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2774d-2d2b-4419-a22d-2fd9e388428c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:31.817370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2774d-2d2b-4419-a22d-2fd9e388428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:31.884375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4cd2774d-2d2b-4419-a22d-2fd9e388428c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:31.885584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4cd2774d-2d2b-4419-a22d-2fd9e388428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:31.939664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:31.988429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 753/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:32.284379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:32.286109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:32.323503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:32.392128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c487d1-1056-475d-9aa1-5686b0460eda None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:32.469251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:32.469858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:32.470136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:32.470407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:32.472061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:32.553356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:32.583364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:32.584829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78428f99-055f-4812-a5fb-460e6f95ccba service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:32.603515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 737/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:34.974604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:34.975239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:34.975239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:34.976580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 754/1491] 10.222.0.20 () {54 vars in 927 bytes} [Mon Sep 19 11:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:09:34.982040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920de2-0ce3-45d3-89a3-7c2e681e2c8b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:34.983035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920de2-0ce3-45d3-89a3-7c2e681e2c8b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:34.983252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920de2-0ce3-45d3-89a3-7c2e681e2c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:35.052073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1f920de2-0ce3-45d3-89a3-7c2e681e2c8b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:09:35.053277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1f920de2-0ce3-45d3-89a3-7c2e681e2c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:35.152189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 738/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Sep 19 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:09:35.443579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:09:35.445107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:35.556199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3caabd-292f-4990-a717-a9fd09270dbc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:09:35.640995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:09:35.641609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:09:35.641888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:09:35.642165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:09:35.643816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:09:35.652607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:35.758954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:09:35.760446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664266f5-71c4-493c-b139-0f1769720825 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:09:35.778859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 755/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:09:45.150621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=82 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:09:45.776551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=50 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:56.462165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:56.463109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:56.463429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:56.555268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:56.556421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:56.655626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 739/1494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:10:56.664013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:56.664545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:56.664545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:56.742299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:56.743568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:56.842946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 756/1495] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:10:56.847601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:56.848840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:56.860452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685aefa-8fd3-4660-906f-b153e5aa60cb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:56.929634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:56.964053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:56.964962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:56.965230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:56.965502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:56.966726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:10:56.967033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:56.968085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:56.968085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:10:56.968085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:10:56.968985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:56.981767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 740/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:10:56.990385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:56.999935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01c30b-585b-437b-8a14-8b457deb4500 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:57.061653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:57.098708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:57.099257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.099549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.099808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.100446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:57.102200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:57.102200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:10:57.102200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:10:57.103517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:57.160545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 757/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:10:56 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:10:57.164855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:57.166395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:57.202391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2534076-0576-4917-bd4d-87557231dd79 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:57.299821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:57.300430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.300708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.300976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.301600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:57.302609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:57.302609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:10:57.302609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:10:57.303862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:57.347750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 741/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:10:57 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:10:57.352000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:57.353515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:57.416440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a77ec0-6f3c-472b-bb79-aff2195cfd85 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:57.501239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:57.513517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:57.514121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.514396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.514666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.515337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:57.516400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:57.516400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:10:57.516400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:10:57.517291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:57.529961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 758/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:10:57.534345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:57.535892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:57.547228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650780c-f60c-4061-b82b-eeb803b78fcb admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:57.572746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:57.643524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:57.644128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.644401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.644665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.645292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:57.646295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:57.646295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:10:57.646295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:10:57.647193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c2e3a-df45-43ae-80ef-026efd4660c9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:57.659763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 742/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:10:57.664231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:57.665793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:57.700867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acd14-78be-43b7-9952-1146ebd52c09 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:57.795001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:57.795693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.795973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.796245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] PATH_INFO: `/v3/projects/679512e3821148d1be618fec1bdc293e/users/7ee27417626142d7b998ea73e364df22/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.819399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679512e3821148d1be618fec1bdc293e, user_id=7ee27417626142d7b998ea73e364df22, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:57.820445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:57.820445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:10:57.820445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:10:57.822360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618ab2-4061-4c7d-8082-5eb72840fc97 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:57.848320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 759/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:10:57 2022] PUT /identity/v3/projects/679512e3821148d1be618fec1bdc293e/users/7ee27417626142d7b998ea73e364df22/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:10:57.861299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4e33-3812-41cc-a1c4-f862f06f9940 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:57.861586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4e33-3812-41cc-a1c4-f862f06f9940 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:57.861856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4e33-3812-41cc-a1c4-f862f06f9940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:57.922209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1f6a4e33-3812-41cc-a1c4-f862f06f9940 None None] MFA Rules not processed for user `7ee27417626142d7b998ea73e364df22`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:57.923399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1f6a4e33-3812-41cc-a1c4-f862f06f9940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.002534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 743/1502] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:10:58.015695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.015984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.016261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.017600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 760/1503] 10.222.0.20 () {54 vars in 967 bytes} [Mon Sep 19 11:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:10:58.023118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c64f-8e0d-4b79-b1fc-548225ca5ee3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.023656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c64f-8e0d-4b79-b1fc-548225ca5ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.024273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c64f-8e0d-4b79-b1fc-548225ca5ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.057928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:58.107597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6105c64f-8e0d-4b79-b1fc-548225ca5ee3 None None] MFA Rules not processed for user `7968f762514f42df8264f5cbd1eb37ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:58.108882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6105c64f-8e0d-4b79-b1fc-548225ca5ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.189389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 744/1504] 10.222.0.20 () {58 vars in 1064 bytes} [Mon Sep 19 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:10:58.197280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:58.199068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.251015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:58.308606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032760b-aacb-46df-97f0-2caad821ce31 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:58.384751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:58.385355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.385634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.385909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.387532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.489204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:58.490574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:58.494159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:58.509262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 761/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:10:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:10:58.556103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441798-ff93-412c-8f32-67971fb30a74 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.556513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441798-ff93-412c-8f32-67971fb30a74 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.556666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db441798-ff93-412c-8f32-67971fb30a74 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.557912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 745/1506] 10.222.0.20 () {52 vars in 830 bytes} [Mon Sep 19 11:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:10:58.561544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:58.562785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:58.662397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa4e11-43dc-47ea-9ec1-c300f75a638c service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:58.756831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:58.757484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.757632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.757903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] PATH_INFO: `/v3/users/7ee27417626142d7b998ea73e364df22` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.771204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee27417626142d7b998ea73e364df22)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:58.772260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:58.772260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:10:58.772260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:10:58.773467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:58.783505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:58.843045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee27417626142d7b998ea73e364df22'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:58.843612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee27417626142d7b998ea73e364df22'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:58.852992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee27417626142d7b998ea73e364df22'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:58.853539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee27417626142d7b998ea73e364df22'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:58.867776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee27417626142d7b998ea73e364df22'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:58.897502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 762/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:10:58 2022] DELETE /identity/v3/users/7ee27417626142d7b998ea73e364df22 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:10:58.901916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:58.902203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:58.902478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:58.962711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:10:58.963968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:59.040419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:59.053322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 746/1508] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:10:59.064044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:59.065252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:59.166780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba717d-2949-45f9-8743-bb79c78bc555 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:59.224070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:10:59.246213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:59.246832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:59.247762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:59.248191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:59.249795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:59.362656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:59.364081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742926-318f-4175-99cb-676b2277614b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:59.382500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 763/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:10:59.722314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:10:59.723675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:10:59.735346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1296dd-199b-4a97-883b-e528aca2d4b0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:10:59.836994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:10:59.837620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:10:59.837894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:10:59.838160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] PATH_INFO: `/v3/projects/679512e3821148d1be618fec1bdc293e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:10:59.848432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=679512e3821148d1be618fec1bdc293e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:10:59.849453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:10:59.849453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:10:59.849453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:10:59.850633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:10:59.908762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679512e3821148d1be618fec1bdc293e', 'request_id': 'req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:59.920917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679512e3821148d1be618fec1bdc293e', 'request_id': 'req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:59.928442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679512e3821148d1be618fec1bdc293e', 'request_id': 'req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:59.959609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] The token cache is being invalidate because project 679512e3821148d1be618fec1bdc293e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:10:59.959900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:59.960435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dba3dee-4444-4fe6-ba9b-5a1e3e7d64cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:10:59.961745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 747/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:10:59 2022] DELETE /identity/v3/projects/679512e3821148d1be618fec1bdc293e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:11:09.380152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=62 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:11:09.957547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:34.964268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.965000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.965000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:34.966237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:34.971762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e194-4bab-4a36-8efb-aed084765c67 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:34.972270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e194-4bab-4a36-8efb-aed084765c67 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:34.972385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2e194-4bab-4a36-8efb-aed084765c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.074031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c3b2e194-4bab-4a36-8efb-aed084765c67 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:35.075545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c3b2e194-4bab-4a36-8efb-aed084765c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:35.209968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:35.368277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:35.370663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:35.494444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5323c-f071-422b-8009-c3c4e45a52bd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:35.500011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:35.500633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:35.500917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:35.501193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:35.511200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:35.512830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9d279-2024-4bd9-8092-82744833d2d8 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:35.522519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 765/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:36.622989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac5a8-219c-4efa-9418-9556ae9b998d None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.623581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac5a8-219c-4efa-9418-9556ae9b998d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.623581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac5a8-219c-4efa-9418-9556ae9b998d None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.624928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:36.631343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3144-2f6a-414d-a7e5-4c4fa5952920 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.631906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3144-2f6a-414d-a7e5-4c4fa5952920 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.631906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed3144-2f6a-414d-a7e5-4c4fa5952920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.652259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-23ed3144-2f6a-414d-a7e5-4c4fa5952920 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:36.653471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-23ed3144-2f6a-414d-a7e5-4c4fa5952920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:36.661661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:36.816072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac5a8-219c-4efa-9418-9556ae9b998d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:36.831618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac5a8-219c-4efa-9418-9556ae9b998d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:36.837236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:36.837836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:36.838115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:36.838383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:36.846536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:36.848167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b732f-cfe3-4377-baf3-86d193e0509e service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:36.858096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 750/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:37.095230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b193eb-48a8-4d70-9a9e-d5385215419f None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.095437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b193eb-48a8-4d70-9a9e-d5385215419f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.095682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b193eb-48a8-4d70-9a9e-d5385215419f None None] PATH_INFO: `/v3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.096963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 767/1517] 10.222.0.67 () {54 vars in 925 bytes} [Mon Sep 19 11:12:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:12:37.103959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7b15-bd14-4f4e-a550-dacdb81f29ae None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:37.104246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7b15-bd14-4f4e-a550-dacdb81f29ae None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:37.104520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f7b15-bd14-4f4e-a550-dacdb81f29ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:37.163512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6c0f7b15-bd14-4f4e-a550-dacdb81f29ae None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:37.164959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c0f7b15-bd14-4f4e-a550-dacdb81f29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:37.182283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:12:37.237511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 751/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Sep 19 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:40.827322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c90-f5a5-40e9-bfdc-b69557316c90 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.827935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c90-f5a5-40e9-bfdc-b69557316c90 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.827935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb53c90-f5a5-40e9-bfdc-b69557316c90 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.829229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 768/1519] 10.222.0.20 () {54 vars in 961 bytes} [Mon Sep 19 11:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:40.834347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4dbb-90ec-434f-8c9a-fae8e2eacbd9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.834794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4dbb-90ec-434f-8c9a-fae8e2eacbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.834897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4dbb-90ec-434f-8c9a-fae8e2eacbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.855670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-edda4dbb-90ec-434f-8c9a-fae8e2eacbd9 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:40.856870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-edda4dbb-90ec-434f-8c9a-fae8e2eacbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:40.865526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 752/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Sep 19 11:12:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:40.873615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb53c90-f5a5-40e9-bfdc-b69557316c90 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:40.887696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb53c90-f5a5-40e9-bfdc-b69557316c90 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:40.892567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:40.893152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:40.893428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:40.893695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:40.902725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:40.904338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c087f8b-b635-45ca-aaf8-691b4da97b67 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:40.913786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 769/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:48.352972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63405-9b56-4632-bca5-6eeefbe717e3 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.353494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63405-9b56-4632-bca5-6eeefbe717e3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.353494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d63405-9b56-4632-bca5-6eeefbe717e3 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.356756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:48.361800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5647-833f-4cf6-ae35-7d458d629ef6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.362302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5647-833f-4cf6-ae35-7d458d629ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.362403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd5647-833f-4cf6-ae35-7d458d629ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.382850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-08bd5647-833f-4cf6-ae35-7d458d629ef6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:48.384107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-08bd5647-833f-4cf6-ae35-7d458d629ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:48.392876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:48.549256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63405-9b56-4632-bca5-6eeefbe717e3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:48.563991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d63405-9b56-4632-bca5-6eeefbe717e3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:48.569616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:48.570213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:48.570497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:48.570773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:48.579139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:48.580762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85347115-5260-470d-9ae3-394ed300b457 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:48.590811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 754/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:49.683450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f537-e155-474e-ae38-679d43f6c6d5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.684119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f537-e155-474e-ae38-679d43f6c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.684119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f537-e155-474e-ae38-679d43f6c6d5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.685750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 19 11:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:49.692087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eaaf3-7b10-4efa-8d73-c9ef18fbbc2b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.692540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eaaf3-7b10-4efa-8d73-c9ef18fbbc2b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.692643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eaaf3-7b10-4efa-8d73-c9ef18fbbc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.712282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-dd9eaaf3-7b10-4efa-8d73-c9ef18fbbc2b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:49.714015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-dd9eaaf3-7b10-4efa-8d73-c9ef18fbbc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:49.721932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 19 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:49.894205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f537-e155-474e-ae38-679d43f6c6d5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:49.909349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34f537-e155-474e-ae38-679d43f6c6d5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:49.918263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:49.918263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:49.918263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:49.918263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:49.925812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:49.927476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b49d3-a60c-4e02-ba52-ada261646db5 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:49.937562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 772/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:54.235656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.236227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.236227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.237545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:54.242821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ae74-03f5-4bcc-be5b-f358333af540 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.243290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ae74-03f5-4bcc-be5b-f358333af540 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.243431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7ae74-03f5-4bcc-be5b-f358333af540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.263901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c7c7ae74-03f5-4bcc-be5b-f358333af540 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:54.265108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c7c7ae74-03f5-4bcc-be5b-f358333af540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:54.273164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:54.565023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:54.567297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:54.647238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e1b8-de28-4772-9c33-2a66fdde1ad5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:54.651564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:54.652237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:54.652648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:54.652932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:54.662284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:54.663965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8899e-a32c-44a6-8e24-07028bb7df16 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:54.676235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 757/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:12:56.877806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.878339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.878339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.880113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:12:56.886112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec5b-5815-4275-8871-97f9c8b048d9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:56.886573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec5b-5815-4275-8871-97f9c8b048d9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:56.886679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec5b-5815-4275-8871-97f9c8b048d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:56.907074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-357cec5b-5815-4275-8871-97f9c8b048d9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:12:56.908295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-357cec5b-5815-4275-8871-97f9c8b048d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:56.916134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:12:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:12:57.209835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:12:57.211584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:12:57.225738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d5548-10dd-4b9a-9991-549f2212e354 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:12:57.230015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:12:57.230622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:12:57.230967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:12:57.231286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:12:57.240555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:12:57.241999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b36f4c-34b1-4bed-96e7-c5670dce568d service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:12:57.251606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 775/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:13:01.273475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.274294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.274464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.276747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:01.282654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b10ba-06dd-4a09-851a-5884a2c3574a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.283124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b10ba-06dd-4a09-851a-5884a2c3574a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.283485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b10ba-06dd-4a09-851a-5884a2c3574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.292043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=81 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.305103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a49b10ba-06dd-4a09-851a-5884a2c3574a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:01.306335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a49b10ba-06dd-4a09-851a-5884a2c3574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:01.314445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:13:01.616836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:01.618523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:01.684244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:01.699215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e594-1809-4e2e-80c8-9dce595235be None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:01.703149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:01.703782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:01.704060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:01.704326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:01.714183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:01.715751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f2313-0dda-4657-96b1-85c0f0257593 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:01.728854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 760/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:13:03.905825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.906396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.906396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.907762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 19 11:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:13:03.913019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e08f-c24c-40c4-8192-20c3171da3ef None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:03.913444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e08f-c24c-40c4-8192-20c3171da3ef None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:03.913567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555e08f-c24c-40c4-8192-20c3171da3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:03.936769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4555e08f-c24c-40c4-8192-20c3171da3ef None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:13:03.937996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4555e08f-c24c-40c4-8192-20c3171da3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:03.945999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 19 11:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:13:04.259892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:13:04.262082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:13:04.275253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decdcb8-b7f3-4b07-a9cb-ad258781a671 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:13:04.279411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:13:04.280058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:13:04.280340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:13:04.280623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:13:04.290258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:13:04.292822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6496f-38ff-4413-b0dc-6d4a6fef58f7 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:13:04.302342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 778/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:13:13.930802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=11 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:13:14.298105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:35.776520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:35.777216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:35.777216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:35.802662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:35.808169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:35.818645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 762/1540] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:35.829701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:35.830691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:35.831235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:35.864375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:35.866314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:35.879488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 779/1541] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:35.884101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:35.904582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fa4f-dab8-435f-8f33-774bf0d4f30b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:35.918520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:35.919190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:35.919660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:35.919936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:35.920612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:35.920910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:35.922610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:35.944105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 763/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:35.957755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:35.973651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca511e-f5b5-4afe-9aa3-44f0bbbcf86d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:35.983968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:35.985148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:35.985776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:35.986270 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:35.987139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:35.989374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42d0d-1ac0-4976-bef6-dc556ab4c967 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.047630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 780/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:35 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:36.051996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.077119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34908674-28db-4549-ba19-7692064135c5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.188190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.188811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.189094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.189364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.190014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.191992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.225872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 764/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:36.230377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.230965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.232311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.232713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.246962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9bd46-ce18-48d6-8db0-14583b187e40 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.269897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.270705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.270988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.271284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.271923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.273532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25f707-568b-46d7-a010-c6ebbf57c44f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.303424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.305167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.317713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 765/1545] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:14:36.319055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f630-acb7-44a6-99ef-8f87543205a7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.319510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f630-acb7-44a6-99ef-8f87543205a7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.319783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f630-acb7-44a6-99ef-8f87543205a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.328771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 781/1546] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.335590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.348636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d5788-8371-48c0-82d9-f5a468308a9f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.357172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bcf9f630-acb7-44a6-99ef-8f87543205a7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.359280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bcf9f630-acb7-44a6-99ef-8f87543205a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.363660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.364608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.365297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.365800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.366745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.368961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2047584-26af-422f-b60e-643c48b4054e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.380600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 766/1547] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.382682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 782/1548] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:36.387181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.387181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.387181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.389506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c923081-8e73-4a0e-8686-09c24c9a9b1d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.390036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c923081-8e73-4a0e-8686-09c24c9a9b1d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.390537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c923081-8e73-4a0e-8686-09c24c9a9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.424055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6c923081-8e73-4a0e-8686-09c24c9a9b1d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.425750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6c923081-8e73-4a0e-8686-09c24c9a9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.427474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.429135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.448181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 767/1549] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.448691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 783/1550] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.450123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5af5e-efbc-41f2-a865-6d1d115fa9e2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.451355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.452054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5af5e-efbc-41f2-a865-6d1d115fa9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.452355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5af5e-efbc-41f2-a865-6d1d115fa9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.471124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ae89-907b-4453-9f66-7c7cb08b7f66 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.476093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.476783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.477059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.477329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] PATH_INFO: `/v3/projects/d584f1cf741748faa7e6c88a6419557a/users/c0f3bbc3da1e49b184d357a7cc34f058/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.485633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-69b5af5e-efbc-41f2-a865-6d1d115fa9e2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.486916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-69b5af5e-efbc-41f2-a865-6d1d115fa9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.513030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 784/1551] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.514998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16596a4-8403-4b7f-be06-60879019217c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.515321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16596a4-8403-4b7f-be06-60879019217c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.515634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16596a4-8403-4b7f-be06-60879019217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.523056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d584f1cf741748faa7e6c88a6419557a, user_id=c0f3bbc3da1e49b184d357a7cc34f058, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.524402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:36.524402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:14:36.524402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:14:36.528051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4f6c-e4f5-4dd5-868d-05e842d7dacf admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.544827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f16596a4-8403-4b7f-be06-60879019217c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.545528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 768/1552] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:36 2022] PUT /identity/v3/projects/d584f1cf741748faa7e6c88a6419557a/users/c0f3bbc3da1e49b184d357a7cc34f058/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:36.546584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f16596a4-8403-4b7f-be06-60879019217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.547518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f040-92e9-4611-a2c1-c638b41d2390 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.548018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f040-92e9-4611-a2c1-c638b41d2390 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.548497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1f040-92e9-4611-a2c1-c638b41d2390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.571895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-43d1f040-92e9-4611-a2c1-c638b41d2390 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.575025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-43d1f040-92e9-4611-a2c1-c638b41d2390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.634145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 785/1553] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.636081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16596a4-8403-4b7f-be06-60879019217c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.647001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16596a4-8403-4b7f-be06-60879019217c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.652300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.652926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.653230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.653507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.654287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:36.654528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.655350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 769/1554] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.655606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:36.655606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:14:36.655606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:14:36.656504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.657250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f2c9-0a24-4a5c-a13e-717b57a62cbb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.657672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f2c9-0a24-4a5c-a13e-717b57a62cbb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.658089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f2c9-0a24-4a5c-a13e-717b57a62cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.671662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 786/1555] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:36.675569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.685664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-3d60f2c9-0a24-4a5c-a13e-717b57a62cbb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.685886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20527105-36e3-4a27-9390-7c53e2afcf66 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.686871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3d60f2c9-0a24-4a5c-a13e-717b57a62cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.690818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.691753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.691902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.692076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.692748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:36.693054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.694677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68b0c5-94f9-48a8-ae55-d1da12c3f3c5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.696245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 770/1556] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.704041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f6dd-7e18-4487-b70d-303ce19d3dea None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.704041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f6dd-7e18-4487-b70d-303ce19d3dea None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.704041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f6dd-7e18-4487-b70d-303ce19d3dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.709795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 787/1557] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:36.711068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.711383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.711678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.720130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7ae6f6dd-7e18-4487-b70d-303ce19d3dea None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.721337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7ae6f6dd-7e18-4487-b70d-303ce19d3dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.729850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 771/1558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.731326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9bd-d6b6-489a-a7ca-9277a84c406d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.731786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9bd-d6b6-489a-a7ca-9277a84c406d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.732252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990a9bd-d6b6-489a-a7ca-9277a84c406d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.733168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.734382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.743114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 788/1559] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.743968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.755475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2990a9bd-d6b6-489a-a7ca-9277a84c406d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.756722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2990a9bd-d6b6-489a-a7ca-9277a84c406d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.757628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f9189-0c59-4481-a78d-0df2ea5ac0fe None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.762946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.763601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.763876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.764153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.764802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:36.765107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.766725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.767566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 772/1560] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.769098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb926b-0b69-42fb-b992-d3d583d1eea6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.769951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb926b-0b69-42fb-b992-d3d583d1eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.770235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb926b-0b69-42fb-b992-d3d583d1eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.778639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:36.788247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 789/1561] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:36.788247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.790973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef0c786-8ceb-48cd-a25a-fa6d0173ae21 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.796176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.796784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.797068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.797341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.797971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.799798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7cdb926b-0b69-42fb-b992-d3d583d1eea6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.799926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.801586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7cdb926b-0b69-42fb-b992-d3d583d1eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.809672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 773/1562] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.810958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.811286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.811560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.830909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 790/1563] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:36.832420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.838996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:36.841934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:36.871297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:36.921896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e34c3-1a48-4602-94c8-5d484448ec8c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:36.925110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 774/1564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:36.925973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:36.929236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:36.929939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.930496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.930844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.932593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:36.935449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252be1e-500b-455e-ab93-23d38a2c8f33 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:36.967817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 791/1565] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:36.970743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:36.971458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:36.972108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:36.998008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36843b-24ad-4a5d-8219-13b02d5fe16f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.000645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:37.001855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:37.053956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.054681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.055041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.055439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.071525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 792/1566] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:37.073326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.083364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2158-286f-40fd-8518-a00dbd1fe428 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.088142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.088750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.089029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.089303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.089942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:37.090243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.091915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.103518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 793/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:37.104727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.114567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdea7e-b53a-440f-839e-1cb4bf99b4dc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.120316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.121112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.121395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.121669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.122297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.124271 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.128312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.129756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454527-ccf1-4e5e-b3c7-e8b03ba2518f service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.140745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 775/1568] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:37.142018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.142333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.142778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.151860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:37.155275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 794/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.156113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.172999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:37.175125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:37.225684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd292837-b631-4d2e-8390-79313c6a0ca5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.231540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.232411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.232781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.233167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.234379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.235540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:37.235540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:14:37.235540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:14:37.236977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.264365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 795/1570] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.265339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.272494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:37.279550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149cf80-fa6b-4d2a-8114-fb43fc5c680f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.287827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.289142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.289746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.290100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.290898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:37.291994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.294144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.306517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 776/1571] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:37.306517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.315135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 796/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:37.316327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.327238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c1df1-79d7-482a-93cb-9dd3b82a282b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.330055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a41e55-8a48-40af-986f-1cbe30e19789 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.332968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.333729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.333998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.334338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.335041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.335592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.336438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.336793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.337141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.337346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.340571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:37.340571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.340571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.356186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 797/1573] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:37.356902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.367229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1c233-c12b-404e-9ed2-974f8521a33a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.373767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 777/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.373767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.374068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.374607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.375075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.375533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.376529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.381178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.381285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1c73-a1e7-4e3a-9f62-db6dc0e238c3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.386386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.387244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.387644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.387964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.388607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.390833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.417001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 778/1575] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.418038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.423377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 798/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.424525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.430275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb36af-2793-4c79-ae76-43e73a8d7583 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.499479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e6f66-bcd4-4245-a946-71a62d39cb4e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.500436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.501066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.501953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.502248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.502871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.504526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.505001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.505851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.506108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.506482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.507392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:37.507790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.509503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.516716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 779/1577] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:37.520295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.523446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 799/1578] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:37.524269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.538849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3c47-2732-44ec-8ad5-77afb0b75307 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.540541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b05e5e-2d95-4080-b5cf-a5fc9b943d86 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.544074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.544710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.544988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.545249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.545880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.546055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.546758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.546937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:37.546937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:14:37.546937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:14:37.547385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.547758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.548165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.548560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.550571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.581831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 780/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.582914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.588584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 800/1580] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/projects => generated 391 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.589959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.648823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:37.689189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185356-c27a-41bd-8f15-36f16dfd7cec admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.705963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1512d2-d231-4529-97d1-0e0cf84859cf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.712564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.713729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.714077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.714349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.715004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.716974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.731286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 801/1581] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:37.731286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.741129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4136bf7-bd05-4921-825b-90e1a744bf0a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.746034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.746738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.747276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.748010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.748775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.750844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.761009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.761719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.762059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.762422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.763126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.765116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.778356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 802/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.778356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.782225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 781/1583] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:37.783070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.789645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16229a0a-8e89-4553-82b8-52ab81641faa admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.794235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a55a42-68e2-4764-9acf-0f654f686ff3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.795047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.795975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.796357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.796737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.797518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.799179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.799352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.799951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.800223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.800490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.801120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.801345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:37.803629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.815334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 803/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:37.816243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.827679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf4f-c44b-464b-8f50-24376c4b759a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.834400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.835133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.835380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.835739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.836323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.839020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.845059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 782/1585] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.845059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.866756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 804/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 294 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.866756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.880001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92fc6c-4913-4394-a887-25038f12f100 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.927479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c53ff-35aa-4eb1-b4fe-5abd9cab757f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.933857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.934481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.934761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.935015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.935689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.939793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.967589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:37.970951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 783/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:37 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:37.970951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:37.971919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:37.972377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:37.972816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:37.973685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:37.975825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:37.984620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d01b51-7af4-42cf-91ab-dd45d953178e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:37.990586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 805/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:37.991779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.008812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.010514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.011053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.011767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.012824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.013047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa39ea4-79e0-40ea-9808-a0551ee1a080 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.014810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.028722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.029849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 784/1589] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.031126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.033381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.033816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.034180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.035083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.037423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.046592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b376a-13a3-49bf-b8ad-7b1db8a6378d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.052019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.053132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.053603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.053870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 806/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.054205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] PATH_INFO: `/v3/projects/4f8b8b3ba11f45389c64985a1ee1481b/users/cc4e6ebb70d2450ab66c68b19d82b7ab/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.055959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.069745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee7ab-f9ca-4459-b1c6-41b0dfa65b4e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.076274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.077135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.078630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.079011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.079943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.082124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.084075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8b8b3ba11f45389c64985a1ee1481b, user_id=cc4e6ebb70d2450ab66c68b19d82b7ab, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.089989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.110614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 785/1591] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/4f8b8b3ba11f45389c64985a1ee1481b/users/cc4e6ebb70d2450ab66c68b19d82b7ab/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:38.111855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.115593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 807/1592] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:38 2022] POST /identity/v3/users => generated 283 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:38.116521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.129652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee2939-8493-4a5b-a632-f14d0fc28537 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.155638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:38.208982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.209873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.210949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.211412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.213771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.215525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.226348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfe54-ed30-477c-abab-30301c48824c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.230030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 808/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.231040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.233778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.235040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.235525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.235981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.236790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.238573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.246482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dd927-3b30-4656-8c37-ad2b2dfb0ebd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.252891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.253556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.253833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.254274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] PATH_INFO: `/v3/projects/eea448c9ef5648b7a8ed927a32ee5a73/users/d5c0ded3e87f47ffaebfa4c25c5ee4e7/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.258010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 786/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.258010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.268946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d0cdb-b0fc-46a8-933c-ab47450c5177 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.274154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.275080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.275476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.276424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea448c9ef5648b7a8ed927a32ee5a73, user_id=d5c0ded3e87f47ffaebfa4c25c5ee4e7, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.276665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.277389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.279353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.280528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a6685-105a-40e9-bf14-8e250c1bba4a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.293221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 787/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.294172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.311376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 809/1596] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/eea448c9ef5648b7a8ed927a32ee5a73/users/d5c0ded3e87f47ffaebfa4c25c5ee4e7/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:38.313240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.313555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.316690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.318609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee2437-f383-4d7d-a8c9-27c332b6760d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.340614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:38.342805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:38.360945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:38.406582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.407403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.408035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.408316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] PATH_INFO: `/v3/projects/f9c8075d9f6148748e9345e7fc536641/users/6e0f82a6b33a48eab226a7609f795d5e/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.429740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c8075d9f6148748e9345e7fc536641, user_id=6e0f82a6b33a48eab226a7609f795d5e, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.433377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.434373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 810/1597] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:38.435514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.456029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53d633-e6d8-4b5a-91fc-c016327d7a22 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.456703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 788/1598] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/f9c8075d9f6148748e9345e7fc536641/users/6e0f82a6b33a48eab226a7609f795d5e/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:38.457818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.533504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.534536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.534968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.535747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.537249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.539613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.559043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 811/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.560266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.562866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b4d56-1110-48ac-b046-f12ca6980bbe admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.571259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.572043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.572457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.572871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.573640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.574243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204797f-2201-45f6-bf64-a63335fe75d3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.575877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.581058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.581890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.582333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.582749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.583578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.585966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f9137-bec7-440f-9fb5-74a5e7852a7f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.591613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 789/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.593091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.601430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 812/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.603079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c093e-0262-44a5-a1ad-9f6c59b60964 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.604193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c093e-0262-44a5-a1ad-9f6c59b60964 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.604943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c093e-0262-44a5-a1ad-9f6c59b60964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.608282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a5d45-e40d-4d74-9d7a-8963d4d386ed admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.613838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.614514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.614793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.615069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] PATH_INFO: `/v3/projects/827be97b96f84769b2e2e45041863f10/users/07e7376d67e840b3bf79524b756e993b/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.640087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827be97b96f84769b2e2e45041863f10, user_id=07e7376d67e840b3bf79524b756e993b, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.644187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3a1c093e-0262-44a5-a1ad-9f6c59b60964 None None] MFA Rules not processed for user `d5c0ded3e87f47ffaebfa4c25c5ee4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:38.645339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.645951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3a1c093e-0262-44a5-a1ad-9f6c59b60964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:38.656955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:38.669747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 790/1602] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/827be97b96f84769b2e2e45041863f10/users/07e7376d67e840b3bf79524b756e993b/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:38.670629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.744897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 813/1603] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:38.747374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.747827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.748663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.769487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d27817-3a1e-4e9a-bf07-fbe7eab56a45 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.782922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.784451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.784966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.785442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.795356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] MFA Rules not processed for user `6e0f82a6b33a48eab226a7609f795d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:38.797440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:38.831378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:38.892848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.894787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.912091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 791/1604] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:38.917627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 814/1605] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:38.917627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.918574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.934534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684752d-e09d-47ae-ac52-4f623fab75e0 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.944062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.944303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e6022-8dca-4539-b7fd-222f3a3aca14 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:38.944629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.957693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.958507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.959554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.959678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:38.960483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:38.960883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:38.961449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] PATH_INFO: `/v3/projects/6c50c1a936574c1b843c7c206a71bdd5/users/59fb0a1e033f4f94aa83d339946d34eb/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:38.961966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:38.976637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 792/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:38.981814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:38.984406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c50c1a936574c1b843c7c206a71bdd5, user_id=59fb0a1e033f4f94aa83d339946d34eb, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:38.987428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d70346-4ace-475a-9808-f1e2805da6d6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.004273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa720-c2ea-4c86-8644-70afec37a1f6 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.016439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 815/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/6c50c1a936574c1b843c7c206a71bdd5/users/59fb0a1e033f4f94aa83d339946d34eb/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:39.020478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07ad7-6a6f-4868-8bf2-92dba05b47e4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.020997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07ad7-6a6f-4868-8bf2-92dba05b47e4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.021507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a07ad7-6a6f-4868-8bf2-92dba05b47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.063385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e4a07ad7-6a6f-4868-8bf2-92dba05b47e4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:39.065750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e4a07ad7-6a6f-4868-8bf2-92dba05b47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:39.117683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.118774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.119437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.120121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] PATH_INFO: `/v3/projects/d051b9dbe83c4424a707c367159a48c7/users/3f98d05425424579a13cc21bcbb5ab79/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.142285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d051b9dbe83c4424a707c367159a48c7, user_id=3f98d05425424579a13cc21bcbb5ab79, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.145847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.154211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 816/1608] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:39.156381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eca1-cd0c-4194-a13f-e5933fe4f054 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.156694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eca1-cd0c-4194-a13f-e5933fe4f054 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.156958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eca1-cd0c-4194-a13f-e5933fe4f054 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.163202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 817/1609] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 19 11:14:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:39.164452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2eca1-cd0c-4194-a13f-e5933fe4f054 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.268970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2eca1-cd0c-4194-a13f-e5933fe4f054 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.268970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.268970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.268970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.283914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.283914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.283914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c7708-fd1e-4452-8d60-81ac62e3068d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.284589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 793/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:38 2022] PUT /identity/v3/projects/d051b9dbe83c4424a707c367159a48c7/users/3f98d05425424579a13cc21bcbb5ab79/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:39.284589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.284965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 818/1611] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:39.284965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60286-3243-400d-bdbc-ee0557413cee None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.284965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60286-3243-400d-bdbc-ee0557413cee None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.284965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c60286-3243-400d-bdbc-ee0557413cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.318740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:39.358230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-90c60286-3243-400d-bdbc-ee0557413cee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:39.361296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-90c60286-3243-400d-bdbc-ee0557413cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:39.383723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7440-95db-4be5-9bc5-92f9999df3da admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.514929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 819/1612] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:39.515630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281c0e3-fd75-4d42-b671-87cba6e91c29 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.515914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281c0e3-fd75-4d42-b671-87cba6e91c29 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.516197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281c0e3-fd75-4d42-b671-87cba6e91c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.546836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.547715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.547869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.548094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] PATH_INFO: `/v3/projects/af277d1ae0274a8584a20fcfe4bc7fd1/users/2075fa9fd3ad437fa3994997a10ceef1/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.566706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af277d1ae0274a8584a20fcfe4bc7fd1, user_id=2075fa9fd3ad437fa3994997a10ceef1, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.570226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.581024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:39.594540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 794/1613] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:39 2022] PUT /identity/v3/projects/af277d1ae0274a8584a20fcfe4bc7fd1/users/2075fa9fd3ad437fa3994997a10ceef1/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:39.595713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.596164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7281c0e3-fd75-4d42-b671-87cba6e91c29 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:39.599686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7281c0e3-fd75-4d42-b671-87cba6e91c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:39.706015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639cc30-295f-46af-9d33-3c86dcd227c9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.708286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 820/1614] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:39.710384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.710728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.710957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.712210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.712943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.713322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.713811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.751640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] MFA Rules not processed for user `3f98d05425424579a13cc21bcbb5ab79`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:39.753587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:39.830761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.833790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.843729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:39.864955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 795/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:39.866063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.874419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 821/1616] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:39.874967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.879894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b862678-b2bc-427b-8535-1387d8ff067b service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.886149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96ef3a-4452-4e1b-89c7-ed19b73edb25 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.886847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.887684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.888132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.888559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.890034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.890439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.890657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.890935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.891231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.894061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae352201-6005-41e2-8a17-51991f095cd8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.908520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:39.911252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:39.928844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 796/1617] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/users => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:39.930817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.932441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 822/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:39.933118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.933628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:39.933826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.947850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51152dd-8466-4f04-81e3-caa1de1014f1 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:39.955225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:39.955963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:39.956253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:39.956543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:39.976325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] MFA Rules not processed for user `2075fa9fd3ad437fa3994997a10ceef1`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:39.979321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:40.061167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.068047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.081180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 797/1619] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:40.082351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.092529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 823/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:40.093505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.105897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98423dc7-0d8a-4820-8772-607381b90c2a service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.112503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.113187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.113469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.113670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab8bf6-7f54-4430-8277-60996848a9c9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.113777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.114597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.116584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.124727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:40.137678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 824/1621] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:40.139193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.139415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.140051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.140449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.140592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.141246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.143204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.205029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 798/1622] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:40.206072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.256252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288d9d-f5b6-49e3-9f40-3f41dd2474ae admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.359954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a758a0-6151-4e41-96ef-375555336711 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.372615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.373226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.373503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.373776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] PATH_INFO: `/v3/projects/0ed714d07fc940e58349a679110e7500/users/8141354dcb6d4233be12a229b14f0d60/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.392261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.395329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.395618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.396299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.412001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed714d07fc940e58349a679110e7500, user_id=8141354dcb6d4233be12a229b14f0d60, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.416981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.444308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 799/1623] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:40 2022] PUT /identity/v3/projects/0ed714d07fc940e58349a679110e7500/users/8141354dcb6d4233be12a229b14f0d60/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:40.445176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.519613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:40.520259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.527591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.548028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 825/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:40.549106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.561750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371722a-b0a6-4b5f-965c-33302d56a51c service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.630861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a720c-a495-4f05-896c-5ff428e9c764 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.645563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.646075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.646362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.646641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.647566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.650106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e9721-79be-45c5-bb3b-ccd16c2f4756 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.661393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.662396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.662898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.663422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.664268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.666295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb62847-6a2c-4593-b52f-ddccf632c0c3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.680011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 826/1625] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:40.684670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584e01-a470-438e-9f8a-923bf58c1ad7 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.685375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584e01-a470-438e-9f8a-923bf58c1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.686598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4584e01-a470-438e-9f8a-923bf58c1ad7 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.690868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 827/1626] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 19 11:14:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:40.692478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4584e01-a470-438e-9f8a-923bf58c1ad7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.701173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 800/1627] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:40 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:40.703678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77aeb5-d417-465a-92f0-26a7123aa6d7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.704181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77aeb5-d417-465a-92f0-26a7123aa6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.704627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77aeb5-d417-465a-92f0-26a7123aa6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.728967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4584e01-a470-438e-9f8a-923bf58c1ad7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.736886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-df77aeb5-d417-465a-92f0-26a7123aa6d7 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:40.738387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-df77aeb5-d417-465a-92f0-26a7123aa6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:40.741825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.742662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.743069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.743461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] PATH_INFO: `/v3/projects/0ed714d07fc940e58349a679110e7500/users/8141354dcb6d4233be12a229b14f0d60/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.747974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed714d07fc940e58349a679110e7500, user_id=8141354dcb6d4233be12a229b14f0d60, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.754565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.762518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:40.785855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 828/1628] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:40 2022] PUT /identity/v3/projects/0ed714d07fc940e58349a679110e7500/users/8141354dcb6d4233be12a229b14f0d60/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:40.787205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:40.856582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 801/1629] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:14:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:40.858793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.859084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.859389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.932845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] MFA Rules not processed for user `8141354dcb6d4233be12a229b14f0d60`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:40.936862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:40.949286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fb0b9-5f38-4827-b5e2-7470d3b39b5e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:40.955322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:40.956185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:40.956789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:40.957227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:40.958036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:40.960395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:40.974274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 829/1630] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:40.975479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:41.101096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad8864-ceb1-4a56-9797-bf8bcaf7f9a0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:41.108865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:41.109780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.111793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.112283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.134347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 802/1631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:41.135530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:41.164687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b8378-31ca-4e17-a05b-d4df0c0ce1da None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:41.178454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:41.179556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.181191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.182231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] PATH_INFO: `/v3/projects/4723c1eebc444571b95d7611d0eaf5d7/users/18823743429742328f04e84e1b3057c6/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.226234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4723c1eebc444571b95d7611d0eaf5d7, user_id=18823743429742328f04e84e1b3057c6, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:41.230639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:41.259546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 803/1632] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:41 2022] PUT /identity/v3/projects/4723c1eebc444571b95d7611d0eaf5d7/users/18823743429742328f04e84e1b3057c6/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:41.261910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:41.311515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:41.358813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:41.360507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:41.391848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 830/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:41.409438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba1f2d-d695-4ec1-a429-2118e988907a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:41.418041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:41.418880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.419468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.419871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.420616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:41.422790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49c650-5aa1-4ade-bf98-d2c6abcff075 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:41.444333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:41.453608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 804/1634] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:41.458793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40fce4-38c4-4e20-a2c5-3dc8e90235e0 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:41.464990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:41.465840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.466228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.466605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] PATH_INFO: `/v3/projects/4723c1eebc444571b95d7611d0eaf5d7/users/18823743429742328f04e84e1b3057c6/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.468753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4723c1eebc444571b95d7611d0eaf5d7, user_id=18823743429742328f04e84e1b3057c6, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:41.471901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:41.492623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 831/1635] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:41 2022] PUT /identity/v3/projects/4723c1eebc444571b95d7611d0eaf5d7/users/18823743429742328f04e84e1b3057c6/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:41.503135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.503455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.503738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.559388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:41.589751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] MFA Rules not processed for user `18823743429742328f04e84e1b3057c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:41.591186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:41.616778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:41.700806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf42c-e2d9-4415-8de7-c44b475fb38f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:41.718076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:41.719216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:41.720376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:41.721662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:41.792913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 805/1636] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:41.909995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:41.911700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:41.936715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 832/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:14:42.143222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:42.159226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070afffa-cdb7-4ae4-8bfb-8b66ce194166 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:42.167956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:42.168808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:42.169201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:42.169589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:42.188164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:42.190252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:42.223566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 806/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:42.555454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:42.576196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:42.586476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2a243-623c-45cf-a673-798994df772a service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:42.594160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:42.594786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:42.595464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:42.595464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:42.728115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee107-c3a0-4355-97bd-7118a102bd70 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:42.738430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:42.739905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:42.740461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:42.741400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] PATH_INFO: `/v3/users/3f98d05425424579a13cc21bcbb5ab79` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:42.743642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f98d05425424579a13cc21bcbb5ab79)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:42.747421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:42.748190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:42.749678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608f5cc-4106-4413-bf71-550ec955becd service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:42.765212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 807/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:42.838147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f98d05425424579a13cc21bcbb5ab79'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:42.841097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f98d05425424579a13cc21bcbb5ab79'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:42.858153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f98d05425424579a13cc21bcbb5ab79'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:42.859924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f98d05425424579a13cc21bcbb5ab79'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:42.884293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f98d05425424579a13cc21bcbb5ab79'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:42.897549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:42.930845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 833/1640] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:42 2022] DELETE /identity/v3/users/3f98d05425424579a13cc21bcbb5ab79 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:42.936174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e610-2864-4252-8347-142d638f9040 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:42.936756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e610-2864-4252-8347-142d638f9040 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:42.937325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e610-2864-4252-8347-142d638f9040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:42.976141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fd72e610-2864-4252-8347-142d638f9040 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:43.004188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fd72e610-2864-4252-8347-142d638f9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:43.050164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:43.117722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 808/1641] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:43.200646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:43.203017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:43.206468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c279a-5514-4efd-86b4-ab75c644b212 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.207376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c279a-5514-4efd-86b4-ab75c644b212 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.207784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c279a-5514-4efd-86b4-ab75c644b212 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.209883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 809/1642] 10.222.0.20 () {54 vars in 965 bytes} [Mon Sep 19 11:14:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:14:43.218259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ac07-9d97-499c-b57e-a6a2e19fb1eb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.219725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ac07-9d97-499c-b57e-a6a2e19fb1eb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.220370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6ac07-9d97-499c-b57e-a6a2e19fb1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.267913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-72f6ac07-9d97-499c-b57e-a6a2e19fb1eb None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:43.270376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-72f6ac07-9d97-499c-b57e-a6a2e19fb1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:43.345349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf31d-b832-48c3-8971-eab7c36a854a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:43.356919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:43.357568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.357865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.358133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.378415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:43.380233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056299-6fb3-49e5-bbde-632c1e0d4001 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:43.404808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 834/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:43.438053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 810/1644] 10.222.0.20 () {58 vars in 1062 bytes} [Mon Sep 19 11:14:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:43.443573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.443937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.444430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.446592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 835/1645] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 19 11:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:14:43.454771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.455041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.455560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.485382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:43.487686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:43.530609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:43.533925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 811/1646] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:14:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:43.535796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:43.648798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e823e-0652-48f7-acf2-576025f7d7d6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:43.661358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:43.662369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:43.662888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:43.663476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:43.700649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:43.706009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:43.745560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 836/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:14:46.253496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:46.256454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:46.329184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed57d5-0ece-4336-b98a-8bf9767c372e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:46.346718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:46.348829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:46.350630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:46.351726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] PATH_INFO: `/v3/projects/d051b9dbe83c4424a707c367159a48c7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:46.356184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d051b9dbe83c4424a707c367159a48c7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:46.371906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:46.580479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd051b9dbe83c4424a707c367159a48c7', 'request_id': 'req-f6187c9e-54a2-4cea-ab04-8283d40971a0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:46.605769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd051b9dbe83c4424a707c367159a48c7', 'request_id': 'req-f6187c9e-54a2-4cea-ab04-8283d40971a0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:46.618198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd051b9dbe83c4424a707c367159a48c7', 'request_id': 'req-f6187c9e-54a2-4cea-ab04-8283d40971a0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:46.658759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] The token cache is being invalidate because project d051b9dbe83c4424a707c367159a48c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:46.659060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:46.663321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:46.666084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 812/1648] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:46 2022] DELETE /identity/v3/projects/d051b9dbe83c4424a707c367159a48c7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:46.669933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:46.688992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d6ec8-a67a-40a6-b1bb-9a23727e3d7a service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:46.874660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:46.875360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:46.875639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:46.875908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] PATH_INFO: `/v3/users/18823743429742328f04e84e1b3057c6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:46.881043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18823743429742328f04e84e1b3057c6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:46.902626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:47.074840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:47.092116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18823743429742328f04e84e1b3057c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:47.092800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18823743429742328f04e84e1b3057c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:47.106785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18823743429742328f04e84e1b3057c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:47.110600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18823743429742328f04e84e1b3057c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:47.125748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18823743429742328f04e84e1b3057c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:47.162409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 837/1649] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:46 2022] DELETE /identity/v3/users/18823743429742328f04e84e1b3057c6 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:48.305755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:48.305755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:48.357421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6187c9e-54a2-4cea-ab04-8283d40971a0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:48.498704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:48.565987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:48.566878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:48.567423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:48.568510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] PATH_INFO: `/v3/users/d5c0ded3e87f47ffaebfa4c25c5ee4e7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:48.570514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c0ded3e87f47ffaebfa4c25c5ee4e7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:48.571816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: WARNING py.warnings [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:48.571816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: warnings.warn(msg) Sep 19 11:14:48.571816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: Sep 19 11:14:48.574054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:48.744791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c0ded3e87f47ffaebfa4c25c5ee4e7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:48.746346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c0ded3e87f47ffaebfa4c25c5ee4e7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:48.767805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c0ded3e87f47ffaebfa4c25c5ee4e7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:48.787842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c0ded3e87f47ffaebfa4c25c5ee4e7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:48.791443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d1c7922d-d78a-442b-bdad-220bb5638a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c0ded3e87f47ffaebfa4c25c5ee4e7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:48.869894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 813/1650] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:48 2022] DELETE /identity/v3/users/d5c0ded3e87f47ffaebfa4c25c5ee4e7 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:48.870036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:48.871235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:48.871532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:48.871828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:48.872164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:48.915579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65957-eccf-4fae-b192-702acdcdbf5c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:48.923819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:48.925084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.068121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:49.069361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.069840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.072757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] PATH_INFO: `/v3/projects/4723c1eebc444571b95d7611d0eaf5d7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.075890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4723c1eebc444571b95d7611d0eaf5d7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:49.078099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: WARNING py.warnings [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 19 11:14:49.078099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: warnings.warn(msg) Sep 19 11:14:49.078099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: Sep 19 11:14:49.084095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 814/1651] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:49.085677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:49.095873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:49.097572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.223470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4723c1eebc444571b95d7611d0eaf5d7', 'request_id': 'req-017e96aa-75ee-4cb7-b7f0-acf821f34d27'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:49.230867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6856ae-7a71-474c-b9e5-296c50136aa4 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:49.237230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4723c1eebc444571b95d7611d0eaf5d7', 'request_id': 'req-017e96aa-75ee-4cb7-b7f0-acf821f34d27'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:49.239921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:49.264345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4723c1eebc444571b95d7611d0eaf5d7', 'request_id': 'req-017e96aa-75ee-4cb7-b7f0-acf821f34d27'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:49.320832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] The token cache is being invalidate because project 4723c1eebc444571b95d7611d0eaf5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:49.321600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:49.323894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-017e96aa-75ee-4cb7-b7f0-acf821f34d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:49.331327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 838/1652] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:48 2022] DELETE /identity/v3/projects/4723c1eebc444571b95d7611d0eaf5d7 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:49.333619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2402ea-a093-4bbc-a1b3-2eb038d0064e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.334021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2402ea-a093-4bbc-a1b3-2eb038d0064e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.334401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2402ea-a093-4bbc-a1b3-2eb038d0064e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.388433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:49.389937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.390371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.390920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.395218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.412257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8c2402ea-a093-4bbc-a1b3-2eb038d0064e None None] MFA Rules not processed for user `c0f3bbc3da1e49b184d357a7cc34f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:49.413917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c2402ea-a093-4bbc-a1b3-2eb038d0064e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.498490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:49.575782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:49.580370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:49.604297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 839/1653] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:49.618856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d859-18dd-4d74-aab6-f089c5c7bf07 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.619524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d859-18dd-4d74-aab6-f089c5c7bf07 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.622707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d859-18dd-4d74-aab6-f089c5c7bf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.630698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 815/1654] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:49.636236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:49.639907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.712432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4505d859-18dd-4d74-aab6-f089c5c7bf07 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:49.715334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4505d859-18dd-4d74-aab6-f089c5c7bf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.773772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 840/1655] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:49.780740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.781177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.781561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.862983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:49.866025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:49.894808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 841/1656] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:49.896986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:49.927193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b3ed1-2dea-47af-908b-459bf644b853 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:49.936244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:49.937295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.939477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.939892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.941309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:49.942713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a431c-9b12-4616-a672-e169c231e67a service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:49.943235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:49.946059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:49.958240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:49.958995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:49.959894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:49.962050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:49.975950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 842/1657] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:49.984197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:49.989165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:49.993174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.009572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d73648-0874-42ea-a991-c80b26c93d01 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:50.015440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 816/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:50.019044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:50.019832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.020230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.020927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.021438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:50.024085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.083314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 843/1659] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:49 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:50.084585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:50.101629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeca2ba-bee8-4418-8b26-9457bbb09b86 service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:50.193358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:50.253763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:50.254768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.255525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.256016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.256938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:50.261002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.309958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 817/1660] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:50 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:50.314245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:50.366533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36502f3d-dcb2-4c0c-8f02-24615fd30f03 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:50.386586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:50.387580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.387971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.388261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.389382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:50.391278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.426852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 844/1661] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:50.430820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:50.446571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee195b5-7a9a-4d90-9843-cd854aed2339 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:50.474449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:50.475042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.475360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.475715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.476404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:50.478962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56251d-8948-431b-8b13-2026903a86cc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.511213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 818/1662] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:50.515009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:50.536988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea482e-db08-4949-9b0a-d48544257c9f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:50.558101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:50.558794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.561832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.562377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] PATH_INFO: `/v3/projects/5eccd17990c74031beba7bf859fcd693/users/0a9ef528302246ca89d71a32e4a88452/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.628686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eccd17990c74031beba7bf859fcd693, user_id=0a9ef528302246ca89d71a32e4a88452, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:50.632573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:50.670482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 845/1663] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:50 2022] PUT /identity/v3/projects/5eccd17990c74031beba7bf859fcd693/users/0a9ef528302246ca89d71a32e4a88452/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:50.681853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:50.682313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:50.682797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:50.753100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] MFA Rules not processed for user `0a9ef528302246ca89d71a32e4a88452`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:50.754460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:51.058891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 819/1664] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:51.061885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.189665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae7dd0-91ce-41ca-b8f8-95928dd85a90 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.203610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.204324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.204687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.205029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.205922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.208310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.270700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 846/1665] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:51 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:51.274529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.299374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dc04a-1223-415c-a10f-68c27612cf21 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.438094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.438931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.439258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.439594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.440274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.445893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.500730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 820/1666] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:51 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:14:51.501828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.516815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9371be-fca7-44f9-9d87-142f843be171 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.529781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.530676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.530966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.531474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.531983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.536177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.548886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.550972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:51.570918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 847/1667] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:14:51.573769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.577479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809c18f-9ab4-44bb-b0ab-ca7697dc4f77 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.588536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.589526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.589890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.590354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] PATH_INFO: `/v3/projects/eea448c9ef5648b7a8ed927a32ee5a73` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.603758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea448c9ef5648b7a8ed927a32ee5a73)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.605965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.609485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae88afa-9f5b-4536-96b1-60a33440bdd8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.628643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.631996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.632992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.633437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.645062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.647010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.681055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 848/1668] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:51.682094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:51.683626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:51.713366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea448c9ef5648b7a8ed927a32ee5a73', 'request_id': 'req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:51.717553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afeb15-1edd-4f6b-84a8-edc1781cb2c9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:51.723947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea448c9ef5648b7a8ed927a32ee5a73', 'request_id': 'req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:51.731009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea448c9ef5648b7a8ed927a32ee5a73', 'request_id': 'req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:51.736402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:51.761051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] The token cache is being invalidate because project eea448c9ef5648b7a8ed927a32ee5a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:51.761355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:51.762075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3e58dfb-c3b9-4242-b2b6-5a3c31f6c16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:51.763959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 821/1669] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:51 2022] DELETE /identity/v3/projects/eea448c9ef5648b7a8ed927a32ee5a73 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:14:51.768642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f16a2-5740-44a9-bf87-f34e203ae55b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.768936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f16a2-5740-44a9-bf87-f34e203ae55b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.769214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f16a2-5740-44a9-bf87-f34e203ae55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.807959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-426f16a2-5740-44a9-bf87-f34e203ae55b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:51.809210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-426f16a2-5740-44a9-bf87-f34e203ae55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:51.858201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:51.860439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.860772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.861046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] PATH_INFO: `/v3/projects/844337ccfb724db881fa713aa7733f98/users/1e3d8321426642918f7c969c4ffa4d7f/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.896331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844337ccfb724db881fa713aa7733f98, user_id=1e3d8321426642918f7c969c4ffa4d7f, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:51.904340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e3a90-55bc-4af4-bc4c-52a535fe5416 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:51.937903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 849/1670] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:51 2022] PUT /identity/v3/projects/844337ccfb724db881fa713aa7733f98/users/1e3d8321426642918f7c969c4ffa4d7f/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:51.949369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:51.949994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:51.950382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:51.989577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 822/1671] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:52.002181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.007397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.010720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] MFA Rules not processed for user `1e3d8321426642918f7c969c4ffa4d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:52.012016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.012529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.144944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:52.154647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.193711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 850/1672] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:52.200154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:52.203598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.410207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c904-13d6-4c58-b917-bdb21d983250 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:52.417730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 823/1673] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:52.419286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:52.425765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:52.426385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.439484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.442965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.443753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.450033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:52.454839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:52.482350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d7ae2-0510-49ba-afc9-146986cee901 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:52.501686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:52.502724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.503307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.503771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] PATH_INFO: `/v3/users/2075fa9fd3ad437fa3994997a10ceef1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.505545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2075fa9fd3ad437fa3994997a10ceef1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:52.510349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:52.529145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 851/1674] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:52 2022] POST /identity/v3/projects => generated 387 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:52.531401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:52.554889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:52.639010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2075fa9fd3ad437fa3994997a10ceef1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:52.640569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2075fa9fd3ad437fa3994997a10ceef1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:52.667858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2075fa9fd3ad437fa3994997a10ceef1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:52.682925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:52.683452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a767-aa24-449a-b291-8bab53d840e3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:52.687061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2075fa9fd3ad437fa3994997a10ceef1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:52.688141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2075fa9fd3ad437fa3994997a10ceef1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:52.709802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:52.712428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.714135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.714959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.718995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:52.720901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:52.722717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:52.734974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 824/1675] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:52 2022] DELETE /identity/v3/users/2075fa9fd3ad437fa3994997a10ceef1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:52.739858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:52.745174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.757510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 852/1676] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:52.758601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:52.764255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:52.797546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49936239-6f9d-44ec-8d11-9526503eb1dc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:52.907332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645680-f16a-421c-a6d9-01fb97c0ba55 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:52.921381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:52.922157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.922314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.922582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] PATH_INFO: `/v3/users/6e0f82a6b33a48eab226a7609f795d5e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.926766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0f82a6b33a48eab226a7609f795d5e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:52.929209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:52.939897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:52.940530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:52.940807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:52.941078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:52.955431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:52.955431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88435-986b-480c-8493-b5fa38897e2b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.001098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 853/1677] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:52 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:53.002707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.003125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.003426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.042126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0f82a6b33a48eab226a7609f795d5e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:53.042855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0f82a6b33a48eab226a7609f795d5e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:53.052941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:53.054569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.059482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0f82a6b33a48eab226a7609f795d5e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:53.073662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0f82a6b33a48eab226a7609f795d5e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:53.074860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f59e443-69ae-4439-9b54-3ba60be9732d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0f82a6b33a48eab226a7609f795d5e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:53.085716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 854/1678] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:53.087794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.089551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.115506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb3c43-02db-4c83-b24d-fc6e0507bc0e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.121990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 825/1679] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:52 2022] DELETE /identity/v3/users/6e0f82a6b33a48eab226a7609f795d5e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:53.126220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.126509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.127242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.129639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.132745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.133143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.133428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.136453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.138717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.166960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] MFA Rules not processed for user `cc4e6ebb70d2450ab66c68b19d82b7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:53.168515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.193625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 855/1680] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:53 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:53.194512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.196677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.292158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:53.344904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 826/1681] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:53.346618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.362809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.389825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9e18-d6e3-42d9-808f-30499b51dd60 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.410007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.410553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.410840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.411130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.420168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.425091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f0258-b96b-4bcd-8f3a-8807a3449e90 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.443209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:53.458598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 856/1682] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:53.460728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.462589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.462949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.508626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:53.512330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.532960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 857/1683] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:53.533923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.539079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.544843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93497aa9-c880-4b22-b11e-9f376c5b95fb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.564691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566bf1-50cb-43dd-ae4f-34e054b6da11 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.579679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.580316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.580586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.580854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.581488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.586646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.628856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 858/1684] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:53 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:53.630916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.639363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.679287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.685278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.685278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.685278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.689536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:53.721463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.723772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.757141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 827/1685] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:53.759571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.786064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f55a7b-6ecb-4441-b18c-1dda064e2da8 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.796275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.797475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.797989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.798465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] PATH_INFO: `/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924/users/f5e32fa8510a495996c34faaa8676f22/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.828684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c9bb-1078-4fab-83cb-27dd534563d7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:53.831945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4acdb6a0ad450ba2a1791c35ad8924, user_id=f5e32fa8510a495996c34faaa8676f22, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.835788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:53.839323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:53.839962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:53.840378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:53.840995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:53.889995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 828/1686] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:53 2022] PUT /identity/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924/users/f5e32fa8510a495996c34faaa8676f22/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:53.891349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:53.992691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:53.996028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.034023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 859/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:54.036174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.040734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:54.073208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb4ef4-2c84-454f-8beb-9d971cb881b8 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.073879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42a103-c8c7-47c0-99f0-638c276eeddb service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.087745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.088874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.089156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.089429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.092560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.094195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.128592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 829/1688] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:54.129096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.159490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1efccf-91f1-416e-8e6e-d79bbf9fd65e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.171337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.172101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.174328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.174969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.175817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.176531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.176745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.177041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.177946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.184724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.206441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.210247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.217526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 830/1689] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:54.219807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.226448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 860/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:54.227465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.239265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:54.250570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc620e-8b91-4b54-9f51-fad59cbd52fb admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.250798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d1138-1016-4162-8318-94e4eff1b2c0 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.254844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.255760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.256145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.256516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.257415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.259336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.264152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.266007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.266953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.267939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] PATH_INFO: `/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924/users/f5e32fa8510a495996c34faaa8676f22/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.282037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4acdb6a0ad450ba2a1791c35ad8924, user_id=f5e32fa8510a495996c34faaa8676f22, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.289999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa702a-efc3-4125-b214-2ed90cc9ea62 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.302972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 831/1691] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:54.304128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.324081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 861/1692] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:54 2022] PUT /identity/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924/users/f5e32fa8510a495996c34faaa8676f22/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:54.328712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffad29-269c-42a4-a39f-6a3f894833c0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.336114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.336414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.336897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.351085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:54.425073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] MFA Rules not processed for user `f5e32fa8510a495996c34faaa8676f22`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:54.428973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:54.525242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:54.532763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.533121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.533406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] PATH_INFO: `/v3/projects/06773c6e0cbe4a36b3e50baf2433ceab/users/d6eb337b194449c9b21b9409a709d858/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.598189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06773c6e0cbe4a36b3e50baf2433ceab, user_id=d6eb337b194449c9b21b9409a709d858, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:54.611954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e477e-6024-4535-9936-bf432c2ee951 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:54.658241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 832/1693] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:54 2022] PUT /identity/v3/projects/06773c6e0cbe4a36b3e50baf2433ceab/users/d6eb337b194449c9b21b9409a709d858/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:54.669743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:54.670103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:54.670447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:54.693895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 862/1694] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:14:54.707997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:54.709604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:54.728861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] MFA Rules not processed for user `d6eb337b194449c9b21b9409a709d858`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:54.731304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:54.870630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a489e-dc07-44d9-aa1e-0dd474a5b582 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:54.935218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 833/1695] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:14:54.936131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:55.073978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:55.075846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.076272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.076749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.155052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d677b-a012-4ff7-a667-dc8e43410f0d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:55.173428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:55.174232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.174581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.174926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.175688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:55.178393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:55.215784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:55.263909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 834/1696] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:54 2022] POST /identity/v3/projects => generated 405 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:55.265218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:55.271863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:55.285342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:55.287601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:55.296766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:55.325158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 863/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:55.325779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:55.366640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0208a-7dea-4295-8c2a-516d9478900b service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:55.475932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1f658-512c-4237-8119-5b0b72a481f4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:55.499848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:55.503961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.504122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.504521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] PATH_INFO: `/v3/projects/af277d1ae0274a8584a20fcfe4bc7fd1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.506343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=af277d1ae0274a8584a20fcfe4bc7fd1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:55.508885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:55.592689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:55.593659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.594149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.594625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.596353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:55.598608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:55.684365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af277d1ae0274a8584a20fcfe4bc7fd1', 'request_id': 'req-98828384-81f4-4047-beed-cf870ac31b0e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:55.691311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 864/1698] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:55 2022] POST /identity/v3/users => generated 309 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:55.694187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:55.710237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af277d1ae0274a8584a20fcfe4bc7fd1', 'request_id': 'req-98828384-81f4-4047-beed-cf870ac31b0e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:55.719980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af277d1ae0274a8584a20fcfe4bc7fd1', 'request_id': 'req-98828384-81f4-4047-beed-cf870ac31b0e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:55.739257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed844c-26a2-441f-bb45-71097cda1ba9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:55.739642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] The token cache is being invalidate because project af277d1ae0274a8584a20fcfe4bc7fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:55.740186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:55.741173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98828384-81f4-4047-beed-cf870ac31b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:55.743274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 835/1699] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:55 2022] DELETE /identity/v3/projects/af277d1ae0274a8584a20fcfe4bc7fd1 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:55.749079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf711fa-aa44-433e-be29-915ee28af0ce None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.749840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf711fa-aa44-433e-be29-915ee28af0ce None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.750360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf711fa-aa44-433e-be29-915ee28af0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.833613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-baf711fa-aa44-433e-be29-915ee28af0ce None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:55.836960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-baf711fa-aa44-433e-be29-915ee28af0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:55.939115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:55.941780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:55.943079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:55.943898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:55.947842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:55.952823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:55.979064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 865/1700] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:55.982974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:55.990787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:56.035753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a9bad-1787-464c-9507-3c07673ee660 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.041292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 836/1701] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:14:56.058389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.066213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.066948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.067580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.068630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] PATH_INFO: `/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad/users/8e44bc0ce6e44038a2e3068610f97b18/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.074307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.074627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.149787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16d9e8fbef84fd590bff4b7ef9365ad, user_id=8e44bc0ce6e44038a2e3068610f97b18, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.156928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.160330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:56.162431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:56.195063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 837/1702] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:56.198800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.220395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 866/1703] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:55 2022] PUT /identity/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad/users/8e44bc0ce6e44038a2e3068610f97b18/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:56.226740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.233506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65385-77ae-406b-9901-8c22dec6ddec None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.291330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:56.396993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:56.420477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11718-368b-4e4c-98c3-a6046b1dc2b3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.441855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.446335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.447449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.447745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.448089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.449175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.449378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:14:56.449731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.450136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.450677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.451222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.454240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.455745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.490512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 867/1705] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:56.490747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 838/1705] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:14:56.498183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.505940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.526055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594c9c3-bf2f-40e6-b9ba-9d606f7e1549 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.533651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.534510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.534938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.535483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] PATH_INFO: `/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad/users/8e44bc0ce6e44038a2e3068610f97b18/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.537780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16d9e8fbef84fd590bff4b7ef9365ad, user_id=8e44bc0ce6e44038a2e3068610f97b18, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.542908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba46d80-6f0f-4704-ad70-bdee69e4ab7f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.546070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.570416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 868/1706] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:56 2022] PUT /identity/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad/users/8e44bc0ce6e44038a2e3068610f97b18/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:56.571726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.574263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:56.689900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cad28-a853-4c32-959a-3a7df5fd9cbc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.694381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.695264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.695977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.696262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.703960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:56.711735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.712927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.713197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.715371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.716042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.722179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ab41f-4b7e-4e4e-9f68-e0f700e9540a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.798868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:56.800594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:56.804093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 839/1707] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:56 2022] POST /identity/v3/projects => generated 353 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:56.811659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.812598 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.816158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:56.817089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 869/1708] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:56.820234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:56.853576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8fcf-820d-40e8-b42d-1113d5200069 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:56.908349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] MFA Rules not processed for user `8e44bc0ce6e44038a2e3068610f97b18`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:56.910297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:56.993161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:56.994668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:56.995383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:56.995833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.004444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.009533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:57.083376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 870/1709] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:56 2022] POST /identity/v3/users => generated 277 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:57.084675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.135591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37f139-27fb-433c-a212-7ea479fe5b7f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:57.173465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:57.174776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.175264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.175663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.176744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.178984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:57.201687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 840/1710] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:57.208538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.211473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:57.219533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 871/1711] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:57.220891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.262007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d898d-f33f-4636-ad2b-0379ee7e1388 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:57.300660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:57.301507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.301935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.302336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.304788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.316399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:57.329138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:57.335448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:57.338756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 872/1712] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:57.345573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.375091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b9e4f-351d-4d37-8737-f254cbe748c9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:57.381308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:57.382266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.382732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.383164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] PATH_INFO: `/v3/projects/1aa4db3596dd4fe7983019a6a1d4e028/users/40743a8c956f41d0aefb9d064e56d794/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.409375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa4db3596dd4fe7983019a6a1d4e028, user_id=40743a8c956f41d0aefb9d064e56d794, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.419638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630bdee-201b-464e-9b46-97b7dc55944a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:57.465571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 873/1713] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:57 2022] PUT /identity/v3/projects/1aa4db3596dd4fe7983019a6a1d4e028/users/40743a8c956f41d0aefb9d064e56d794/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:57.480880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.481169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.481447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.513889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90e692-1529-4839-8b6a-833f4ad35e34 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:57.590665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] MFA Rules not processed for user `40743a8c956f41d0aefb9d064e56d794`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:57.591975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:57.675943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:57.676569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.676845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.677114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.796355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 874/1714] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:14:57.797954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.799940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:57.826353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.828658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:57.848296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 841/1715] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:57 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:57.849880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:57.972088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eade42-826b-4e31-9880-7c5a376fced7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:57.980065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:57.980742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:57.981013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:57.981294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] PATH_INFO: `/v3/projects/f9c8075d9f6148748e9345e7fc536641` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:57.982540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c8075d9f6148748e9345e7fc536641)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:57.984597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:58.042442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b0761-4431-41f7-8374-f10c42b65571 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:58.058071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:58.059326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.059755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.060194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.060945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:58.066977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:58.094420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c8075d9f6148748e9345e7fc536641', 'request_id': 'req-b62150f5-7895-408e-8ae6-09d92d99da60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.104298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c8075d9f6148748e9345e7fc536641', 'request_id': 'req-b62150f5-7895-408e-8ae6-09d92d99da60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.117966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c8075d9f6148748e9345e7fc536641', 'request_id': 'req-b62150f5-7895-408e-8ae6-09d92d99da60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.122989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:58.147830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] The token cache is being invalidate because project f9c8075d9f6148748e9345e7fc536641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:58.148602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.148828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b62150f5-7895-408e-8ae6-09d92d99da60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.154183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 875/1716] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:57 2022] DELETE /identity/v3/projects/f9c8075d9f6148748e9345e7fc536641 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:58.156203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.157083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.157083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.186900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 842/1717] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:14:57 2022] POST /identity/v3/projects => generated 357 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:58.192661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:58.195295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:58.218768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] MFA Rules not processed for user `c0f3bbc3da1e49b184d357a7cc34f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:58.226991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:58.256995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:58.414670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 876/1718] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:58.415740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:58.418603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:58.432797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ecc4b-cb82-4fd4-a8ab-847785ec019b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:58.442812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:58.442812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.443098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6e8ca-1cd3-46a0-b14a-45d6078fb392 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:58.443253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.443374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] PATH_INFO: `/v3/users/d6eb337b194449c9b21b9409a709d858` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.449232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6eb337b194449c9b21b9409a709d858)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:58.451287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:58.452356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.452640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.452914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] PATH_INFO: `/v3/users/8141354dcb6d4233be12a229b14f0d60` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.453719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:58.454171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8141354dcb6d4233be12a229b14f0d60)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:58.458735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:58.564988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8141354dcb6d4233be12a229b14f0d60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.572818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8141354dcb6d4233be12a229b14f0d60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.600753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6eb337b194449c9b21b9409a709d858'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.601607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8141354dcb6d4233be12a229b14f0d60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.603770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6eb337b194449c9b21b9409a709d858'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.604993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8141354dcb6d4233be12a229b14f0d60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.621897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6eb337b194449c9b21b9409a709d858'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.646334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8141354dcb6d4233be12a229b14f0d60'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.648925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6eb337b194449c9b21b9409a709d858'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.649938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f548b648-5cc5-411d-bf03-ff2a2c7f9ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6eb337b194449c9b21b9409a709d858'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:58.716380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 843/1719] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:58 2022] DELETE /identity/v3/users/d6eb337b194449c9b21b9409a709d858 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:58.718006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05091be-7d99-49e5-a118-4cd9186c5ff3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.718160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05091be-7d99-49e5-a118-4cd9186c5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.718466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05091be-7d99-49e5-a118-4cd9186c5ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.730556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 877/1720] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:14:58 2022] DELETE /identity/v3/users/8141354dcb6d4233be12a229b14f0d60 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:58.731772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:58.745837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:58.769897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-b05091be-7d99-49e5-a118-4cd9186c5ff3 None None] MFA Rules not processed for user `59fb0a1e033f4f94aa83d339946d34eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:58.772357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b05091be-7d99-49e5-a118-4cd9186c5ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:58.951360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef9f8-6981-4b27-8f11-0b5a04c47ed0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:58.966972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 844/1721] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:58.969736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.970574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.971655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.980633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:58.981377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:58.981515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:58.981780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:58.982607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:58.985152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7729b97-1c08-4c2e-a742-2033d3447718 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.090474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 878/1722] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:14:58 2022] POST /identity/v3/users => generated 285 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:14:59.091845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe76-61f5-4bad-abef-374b9880a657 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.092420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe76-61f5-4bad-abef-374b9880a657 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.092778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8abe76-61f5-4bad-abef-374b9880a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.092877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] MFA Rules not processed for user `07e7376d67e840b3bf79524b756e993b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:59.094605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.107496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:59.111824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:14:59.144856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6f8abe76-61f5-4bad-abef-374b9880a657 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:59.146236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6f8abe76-61f5-4bad-abef-374b9880a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.185717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 879/1723] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:59.189240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ef6-840c-4859-b503-5298c1a39bef None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.189567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ef6-840c-4859-b503-5298c1a39bef None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.189889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df9ef6-840c-4859-b503-5298c1a39bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.264079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-34df9ef6-840c-4859-b503-5298c1a39bef None None] MFA Rules not processed for user `59fb0a1e033f4f94aa83d339946d34eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:59.265322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-34df9ef6-840c-4859-b503-5298c1a39bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.266752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 845/1724] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:59.268191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.274082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.294671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 880/1725] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:59.294671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.294671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.294671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.308605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f3451-5185-442b-9f08-7c3ad6b9ba12 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.314062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:59.314694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.315292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.315731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.316629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:59.333762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.349338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 846/1726] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:14:59.350627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.354359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.364201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] MFA Rules not processed for user `07e7376d67e840b3bf79524b756e993b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:59.365442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.386660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 881/1727] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:14:59.387624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.391897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.479591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3f645-a997-4cdb-8829-6fa7821d86cd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.483563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:59.484308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.484816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.485188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.502243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fc267-9028-454c-b867-0f1f35b99a0e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.504781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:59.506262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.519691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 882/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:59.531261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:59.532745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.533416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.535114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.553060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.557156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.565202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:59.567372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.596330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 847/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:14:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:14:59.596928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.598836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857066e-98ec-43a8-aaca-77dddef1db8c service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.612782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:59.613499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.613784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.614061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] PATH_INFO: `/v3/projects/0ed714d07fc940e58349a679110e7500` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.616772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed714d07fc940e58349a679110e7500)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:59.619553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d082-1b31-472b-b2dd-e7fb9390933d service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.621502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.628881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:14:59.629566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.630003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.630287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] PATH_INFO: `/v3/projects/8b3ad07422db46f08701a77f3864bf20/users/30104451af9c4975af6bc6651467e617/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.665264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3ad07422db46f08701a77f3864bf20, user_id=30104451af9c4975af6bc6651467e617, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:14:59.673055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:14:59.714013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 848/1730] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:14:59 2022] PUT /identity/v3/projects/8b3ad07422db46f08701a77f3864bf20/users/30104451af9c4975af6bc6651467e617/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:59.728078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:14:59.749725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed714d07fc940e58349a679110e7500', 'request_id': 'req-13d1b852-6c36-4ed3-8387-e0a9c94af355'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:59.766259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed714d07fc940e58349a679110e7500', 'request_id': 'req-13d1b852-6c36-4ed3-8387-e0a9c94af355'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:59.779350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed714d07fc940e58349a679110e7500', 'request_id': 'req-13d1b852-6c36-4ed3-8387-e0a9c94af355'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:59.808887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] The token cache is being invalidate because project 0ed714d07fc940e58349a679110e7500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:14:59.809234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:59.809972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-13d1b852-6c36-4ed3-8387-e0a9c94af355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:14:59.819415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 883/1731] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:14:59 2022] DELETE /identity/v3/projects/0ed714d07fc940e58349a679110e7500 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:14:59.823422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1cdc-6e0e-48a1-8446-467343f15c19 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:14:59.824669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1cdc-6e0e-48a1-8446-467343f15c19 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:14:59.825350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1cdc-6e0e-48a1-8446-467343f15c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:14:59.880668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4eed1cdc-6e0e-48a1-8446-467343f15c19 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:14:59.882347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4eed1cdc-6e0e-48a1-8446-467343f15c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:14:59.901988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e22a4-11e2-4fd5-bc63-6a354eb67c57 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:14:59.908418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:00.042270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.046941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.048682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.049532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.052434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 884/1732] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:00.053180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.059333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.060613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.060974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.061338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.085898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 849/1733] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:00.088899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.090786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.100982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:00.102198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.117224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34950a3-6637-49ab-9c1d-8d3a1d0e5565 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:00.128500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 885/1734] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:00.139177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.143561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.145025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.145148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.145532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] PATH_INFO: `/v3/projects/8b3ad07422db46f08701a77f3864bf20/users/30104451af9c4975af6bc6651467e617/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.147032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:00.153137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3ad07422db46f08701a77f3864bf20, user_id=30104451af9c4975af6bc6651467e617, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.157256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28883f37-4f22-42ca-8b56-fe91de84e759 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.158257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae92fa3-8153-42c1-90cf-69ff996b1c3d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:00.166335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.167511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.167939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.168358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.169181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:00.169630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.171431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93ef0-0110-41fe-bb21-376736dc4e5b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.179206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 850/1735] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:00 2022] PUT /identity/v3/projects/8b3ad07422db46f08701a77f3864bf20/users/30104451af9c4975af6bc6651467e617/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:00.185256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f498-4e5a-4552-aeee-59aa73d4c556 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.186881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f498-4e5a-4552-aeee-59aa73d4c556 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.187725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2f498-4e5a-4552-aeee-59aa73d4c556 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.191764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 851/1736] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 19 11:15:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:00.196617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66f05-39b3-402e-abf2-ce53de0c5ade None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.199327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66f05-39b3-402e-abf2-ce53de0c5ade None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.200462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf66f05-39b3-402e-abf2-ce53de0c5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.201748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 886/1737] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:00.203810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.204266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.205031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.254955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2cf66f05-39b3-402e-abf2-ce53de0c5ade None None] MFA Rules not processed for user `30104451af9c4975af6bc6651467e617`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:00.256583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2cf66f05-39b3-402e-abf2-ce53de0c5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.271521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:00.273069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.424849 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 887/1738] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:00.426442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.507616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 852/1739] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:00.509000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.510077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.510358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.529606 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad805bac-ca37-4146-b04d-b563cd783458 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:00.535954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.536581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.536862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.537383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.537758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.542846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.550357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] MFA Rules not processed for user `cc4e6ebb70d2450ab66c68b19d82b7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:00.551941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.599532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 888/1740] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:00.600278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.602325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.643388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 853/1741] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:00.644485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.650516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.676770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6247cb2-cff6-418f-9a77-d98c307b2027 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:00.715523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e4dd-0e8f-4877-a26e-302a2482b93f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:00.715691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:00.730773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.733424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.733715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.734135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] PATH_INFO: `/v3/projects/06773c6e0cbe4a36b3e50baf2433ceab` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.736059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=06773c6e0cbe4a36b3e50baf2433ceab)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.745000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.771976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:00.785620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:00.786254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.786588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.786876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.796183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:00.797849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:00.808905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 854/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:00.810169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.814275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.865762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06773c6e0cbe4a36b3e50baf2433ceab', 'request_id': 'req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:00.874088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06773c6e0cbe4a36b3e50baf2433ceab', 'request_id': 'req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:00.884735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06773c6e0cbe4a36b3e50baf2433ceab', 'request_id': 'req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:00.901553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] The token cache is being invalidate because project 06773c6e0cbe4a36b3e50baf2433ceab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:00.901998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:00.902988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-57ee9b1c-3242-4ce9-84db-4e93445ba0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:00.906649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 889/1743] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:00 2022] DELETE /identity/v3/projects/06773c6e0cbe4a36b3e50baf2433ceab => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:00.909041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:00.909478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:00.909852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:00.911793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 890/1744] 10.222.0.20 () {54 vars in 912 bytes} [Mon Sep 19 11:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:00.912728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:00.914882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:00.964552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45675ba9-f08c-4450-9aab-81e393fcdc78 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.019999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9214-586e-4b44-8ae3-c717f5a6d5d5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.030240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.030871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.031175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.032085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.032750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.037802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.042913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.044253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.044679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.045090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.047278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.075975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 891/1745] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:00 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:01.075975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.076632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.093385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28b18a-79e9-4a1a-b336-aa36bcb72030 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.104650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.105518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.105813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.106158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] PATH_INFO: `/v3/users/8e44bc0ce6e44038a2e3068610f97b18` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.108544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e44bc0ce6e44038a2e3068610f97b18)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.111476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.215408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.221173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2adb1-4609-4302-b677-59b23d9670d8 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.230145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e44bc0ce6e44038a2e3068610f97b18'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:01.232267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e44bc0ce6e44038a2e3068610f97b18'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:01.251606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 855/1746] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:01.253444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.253744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.254247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.256325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e44bc0ce6e44038a2e3068610f97b18'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:01.257000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e44bc0ce6e44038a2e3068610f97b18'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:01.275329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e44bc0ce6e44038a2e3068610f97b18'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:01.303019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:01.305850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.326585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 892/1747] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:01 2022] DELETE /identity/v3/users/8e44bc0ce6e44038a2e3068610f97b18 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:01.327837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.338068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.353641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:01.377408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:01.451910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 856/1748] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:15:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:01.453235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.454865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.543441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f98b1-d013-4835-b3f5-45ffa20b44cf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.551423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.553143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.553143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.553143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.553578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.556066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.570386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 893/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:01.572813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.576581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.599637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba868cf-70e2-4f62-8005-519db0aef195 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.610718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.611386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.611673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.611952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.620047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.739710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.740660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba62b4-442a-4f09-bb03-2db232b4c13d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.741202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.753767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 857/1750] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:01.754677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.756115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.761208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.761857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.762140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.762413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.764576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.771087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114c398-61ad-409c-9bd2-1418fc6ff765 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.776286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.777118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.777582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.777999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.787476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.789304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.809018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 858/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:01.810259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.811765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:01.904822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.906671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.923210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 894/1752] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:01.924436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:01.959874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50355b50-798d-4774-9dc1-4264c378114d service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.973576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:01.974718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:01.975004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:01.975306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:01.981496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:01.984781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60178f-3b36-4f88-812a-af6ec4457a19 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:01.986499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:01.999653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:02.000819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.001769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.002545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.007863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.039794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 895/1753] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:02.043043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:02.092822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:02.104973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:02.111460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496b0c-6b0d-4a9f-9346-9b3033656777 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:02.124611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:02.127491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.127793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.128105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] PATH_INFO: `/v3/projects/c91c9bd864f443c48671c53fc300bf3c/users/fe37b823532049e9a86cd6fe4d8f5822/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.131005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 859/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:02.131912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:02.147337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.180189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91c9bd864f443c48671c53fc300bf3c, user_id=fe37b823532049e9a86cd6fe4d8f5822, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:02.187365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a603a4-47f4-49a2-af62-b5f616ec8a6b service placement] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:02.188003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4982e-2f0c-49d2-aee9-697dc767f707 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:02.198739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:02.199515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.201055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.203352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] PATH_INFO: `/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.204170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:02.207493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16d9e8fbef84fd590bff4b7ef9365ad)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:02.212512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:02.237093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 896/1755] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:02 2022] PUT /identity/v3/projects/c91c9bd864f443c48671c53fc300bf3c/users/fe37b823532049e9a86cd6fe4d8f5822/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:02.239552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.239839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.240117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.258274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:02.361268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] MFA Rules not processed for user `fe37b823532049e9a86cd6fe4d8f5822`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:02.366025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.433405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16d9e8fbef84fd590bff4b7ef9365ad', 'request_id': 'req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:02.450689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16d9e8fbef84fd590bff4b7ef9365ad', 'request_id': 'req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:02.464364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16d9e8fbef84fd590bff4b7ef9365ad', 'request_id': 'req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:02.498796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] The token cache is being invalidate because project b16d9e8fbef84fd590bff4b7ef9365ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:02.501107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:02.501898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38c7bf70-30e4-4fef-bc55-7c32c29c2fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:02.508623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 860/1756] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:02 2022] DELETE /identity/v3/projects/b16d9e8fbef84fd590bff4b7ef9365ad => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:02.511667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446d27-b671-458c-b173-4aa700719525 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.511924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446d27-b671-458c-b173-4aa700719525 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.513290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446d27-b671-458c-b173-4aa700719525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.517855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 897/1757] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:02.518896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:02.566859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2c446d27-b671-458c-b173-4aa700719525 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:02.568254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2c446d27-b671-458c-b173-4aa700719525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.680821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad9203-cb71-4f91-9168-3d6451c7dc76 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:02.696403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:02.697726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.702520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.702929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.707403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.720164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 861/1758] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:02.721356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446d27-b671-458c-b173-4aa700719525 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:02.723045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2c446d27-b671-458c-b173-4aa700719525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.741875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446d27-b671-458c-b173-4aa700719525 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:02.749039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:02.750546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.751846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.752274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.753308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:02.756258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f26de-cc54-4cc1-8473-3392c6197d2e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:02.818867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 862/1759] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:02 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:02.818867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:02.818867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:02.818867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:02.840698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:02.841903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:02.881028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 898/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:02.882066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:02.908636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:02.911922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:02.914323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee767b-d7a5-4926-be65-d01a4b919763 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.076470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:03.145122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.148214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.148507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.148788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.151623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.158341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.195975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 863/1761] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:03.197476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.217267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 899/1762] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:02 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:03.220582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.230311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a88334-d1bc-48b8-af51-8b0346392bd0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.248169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcca2bd-ba01-434e-abae-6f5c71962290 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.264090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.267296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.267785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.268874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.269702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.274274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.276453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.277567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.277858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.278135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.278805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:03.279114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.286866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.303873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:03.307141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 900/1763] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:03.310841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.320264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 864/1764] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:03.325885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.341160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6113e8-984e-4b70-bc34-e5a5092ea5a6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.353541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.353758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0591bc8-41dd-41fc-9cb3-901686d088f5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.355856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.356138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.356905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] PATH_INFO: `/v3/projects/a6d0d81e8ff24a5fb75a616f476479db/users/afd367d11d6f4082a8c1248036fe86f5/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.369989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.371002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.371323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.371600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.372351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.382154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.413733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0d81e8ff24a5fb75a616f476479db, user_id=afd367d11d6f4082a8c1248036fe86f5, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.428966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.475952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 901/1765] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:03 2022] PUT /identity/v3/projects/a6d0d81e8ff24a5fb75a616f476479db/users/afd367d11d6f4082a8c1248036fe86f5/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:03.480330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.486060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 865/1766] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:03 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:03.490107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.778834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033a24e-c6f8-4087-8e45-29190caa0dd5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.799854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.802632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.803304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1922b3f-fde7-4587-aa61-c977e34a1299 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.806853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.808549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.809486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.817048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.819650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.823637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.823934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.826377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.830307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.839022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.859802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 902/1767] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:03.865308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.909281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 866/1768] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:03 2022] POST /identity/v3/users => generated 284 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:03.911922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:03.912390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f162ef-6443-44ba-aa44-08ebddc2c7b8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.938725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4285a-0370-46da-b24e-8f82198773c0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:03.942541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.945425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.945719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.946002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] PATH_INFO: `/v3/projects/a6d0d81e8ff24a5fb75a616f476479db/users/afd367d11d6f4082a8c1248036fe86f5/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.958674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:03.960041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:03.960339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:03.960620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:03.963122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d0d81e8ff24a5fb75a616f476479db, user_id=afd367d11d6f4082a8c1248036fe86f5, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.966111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572e51-5908-4d3b-b622-145d1ace9912 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:03.966963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:03.983122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:04.003798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 903/1769] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:03 2022] PUT /identity/v3/projects/a6d0d81e8ff24a5fb75a616f476479db/users/afd367d11d6f4082a8c1248036fe86f5/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:04.017991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:04.018477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:04.018579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 867/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:04.018653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:04.019614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:04.049811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1edb33-e18b-47bf-b361-296a0425a749 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:04.130638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] MFA Rules not processed for user `afd367d11d6f4082a8c1248036fe86f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:04.135725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:04.260759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:04.266146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:04.266437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:04.266722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:04.272402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:04.277481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:04.320702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 868/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:04.323712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:04.372009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 904/1772] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:04.396188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:04.396580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307fd9f-4957-411b-ab51-83a42dcaf59d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:04.398015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:04.409063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:04.411714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:04.412170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:04.413835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] PATH_INFO: `/v3/projects/6dd9b958927f4a4a8bb40cac425f6548/users/f971d88cc8444c038d9308cabec0e75b/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:04.422341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:04.469105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd9b958927f4a4a8bb40cac425f6548, user_id=f971d88cc8444c038d9308cabec0e75b, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:04.477150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e40084-bd2d-49d0-84e2-a29b61fcf29e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:04.543983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 869/1773] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:04 2022] PUT /identity/v3/projects/6dd9b958927f4a4a8bb40cac425f6548/users/f971d88cc8444c038d9308cabec0e75b/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:04.557689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:04.558152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:04.559320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:04.587314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd73d6-0c58-4461-9f9f-7f92d6965a26 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:04.661964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] MFA Rules not processed for user `f971d88cc8444c038d9308cabec0e75b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:04.663342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:04.718375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:04.719459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:04.719811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:04.720158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:04.722871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:04.737211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:04.892741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 870/1774] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:04.898258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:04.941402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:04.945035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:04.981052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 905/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:05.167007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852496bf-2fbb-47d8-b209-7c4f064e7a6e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:05.190719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:05.191430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:05.191714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:05.191991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:05.193451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:05.194602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf738fa-edf5-400a-8a7d-dad94e02bf89 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:05.286264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:05.300510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 871/1776] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:04 2022] POST /identity/v3/projects => generated 367 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:05.315038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:05.315371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:05.315766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:05.335470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8369d35-019b-4753-a7cd-104a740ae892 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:05.426979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] MFA Rules not processed for user `59fb0a1e033f4f94aa83d339946d34eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:05.435751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:05.687937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:05.694595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:05.696219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:05.699723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:05.700466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:05.712921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:05.739018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 872/1777] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:05.768739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 906/1778] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:05 2022] POST /identity/v3/users => generated 290 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:05.770341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:05.785750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcce2e-91da-4a52-8834-d43417bc3c7a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:05.793986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:05.796263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:05.796615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:05.796902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:05.798883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:05.801450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:05.866049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 873/1779] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:05.870885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:05.888260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7891-cc41-4981-a0a0-4eb4171a2c98 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:05.904101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:05.905171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:05.905577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:05.906121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] PATH_INFO: `/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7/users/81c894010759460786364263aedec50e/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:05.911544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:05.951499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b530b7006cc4f12ae6f170c4f18f9a7, user_id=81c894010759460786364263aedec50e, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:05.960043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:05.992914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 907/1780] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:05 2022] PUT /identity/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7/users/81c894010759460786364263aedec50e/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:05.998426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:06.014017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f424-26fa-4c92-b025-1ea5cdbb3deb admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:06.120152 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:06.171931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:06.171931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:06.171931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:06.171931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:06.176042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:06.177244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a251cfc-5158-4d02-8597-f639b6e4ee99 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:06.212936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 874/1781] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:06.216985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:06.238311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d9501-c2cc-42f5-b871-85fb3d2524ca admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:06.252330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:06.253713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:06.254969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:06.255360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] PATH_INFO: `/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7/users/81c894010759460786364263aedec50e/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:06.261785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b530b7006cc4f12ae6f170c4f18f9a7, user_id=81c894010759460786364263aedec50e, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:06.269525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:06.328784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 908/1782] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:06 2022] PUT /identity/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7/users/81c894010759460786364263aedec50e/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:06.349479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6857f-fbb8-4fdf-beb6-804ca45132b7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:06.349479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6857f-fbb8-4fdf-beb6-804ca45132b7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:06.349479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6857f-fbb8-4fdf-beb6-804ca45132b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:06.485953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e4e6857f-fbb8-4fdf-beb6-804ca45132b7 None None] MFA Rules not processed for user `81c894010759460786364263aedec50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:06.490840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e4e6857f-fbb8-4fdf-beb6-804ca45132b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:06.787963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 875/1783] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:06.798469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:07.047756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f965b6-23c5-4373-8c4e-a887d4d20a53 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:07.064427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:07.065074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:07.065356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:07.065632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:07.104380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:07.107556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:07.149483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 909/1784] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:07.363656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882e96-9855-4be8-8f2c-61c759e7e680 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:07.364213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882e96-9855-4be8-8f2c-61c759e7e680 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:07.364213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882e96-9855-4be8-8f2c-61c759e7e680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:07.483570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:07.485200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:07.569111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e9882e96-9855-4be8-8f2c-61c759e7e680 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:07.570744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e9882e96-9855-4be8-8f2c-61c759e7e680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:07.774106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226da1b-8bc1-403e-96d6-0c07a37714da service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:07.781096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:07.783205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:07.783481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:07.783969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] PATH_INFO: `/v3/users/0a9ef528302246ca89d71a32e4a88452` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:07.785242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9ef528302246ca89d71a32e4a88452)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:07.787290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:07.864746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 876/1785] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:15:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:07.918841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9ef528302246ca89d71a32e4a88452'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:07.920794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9ef528302246ca89d71a32e4a88452'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:07.951391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9ef528302246ca89d71a32e4a88452'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:07.953269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9ef528302246ca89d71a32e4a88452'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:07.979585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9ef528302246ca89d71a32e4a88452'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:08.016389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:08.054325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 910/1786] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:07 2022] DELETE /identity/v3/users/0a9ef528302246ca89d71a32e4a88452 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:08.069440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:08.070754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:08.072489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:08.121528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:08.123185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:08.253801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:08.323382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:08.324889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:08.437616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 877/1787] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:08.562612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:08.564088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:08.769278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc062-57aa-4093-a461-9f4229b23c15 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:08.778508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc21d-8d52-4c18-bb78-c66f3d026af3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:08.789551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:08.791676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:08.793233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:08.796096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:08.796613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:08.796721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:08.797095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:08.797247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:08.803378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:08.830479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:08.832518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:08.850858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 878/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:09.085025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:09.089462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:09.124788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 911/1789] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:15:09.513731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:09.516573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:09.729433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbb2ab-a131-4f1b-aa24-7abd037aea58 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:09.769735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:09.770647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:09.771240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:09.772676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:09.788393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:10.221485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:10.230372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:10.276180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 879/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:12.509660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:12.512230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:12.534557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99e701-b964-452a-b917-35328c72b8ad service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:12.542210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:12.543315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:12.543817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:12.544323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] PATH_INFO: `/v3/projects/5eccd17990c74031beba7bf859fcd693` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:12.545862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eccd17990c74031beba7bf859fcd693)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:12.548383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:12.667284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eccd17990c74031beba7bf859fcd693', 'request_id': 'req-79cfed68-5120-4407-9976-92fdce0745a9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:12.683223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eccd17990c74031beba7bf859fcd693', 'request_id': 'req-79cfed68-5120-4407-9976-92fdce0745a9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:12.690382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:12.691836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:12.707097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eccd17990c74031beba7bf859fcd693', 'request_id': 'req-79cfed68-5120-4407-9976-92fdce0745a9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:12.718782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:12.735387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6564a0-78d8-4ed9-b97c-554deeae02ba service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:12.757573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] The token cache is being invalidate because project 5eccd17990c74031beba7bf859fcd693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:12.757573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:12.775496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:12.782697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 912/1791] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:12 2022] DELETE /identity/v3/projects/5eccd17990c74031beba7bf859fcd693 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:12.785027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:12.786840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:12.837595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:12.979175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:12.980129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:12.980642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:12.981079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] PATH_INFO: `/v3/users/f971d88cc8444c038d9308cabec0e75b` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:12.984784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f971d88cc8444c038d9308cabec0e75b)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:12.989048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:13.080357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfed68-5120-4407-9976-92fdce0745a9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:13.089728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:13.095534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:13.095890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:13.096626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] PATH_INFO: `/v3/users/1e3d8321426642918f7c969c4ffa4d7f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:13.106165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3d8321426642918f7c969c4ffa4d7f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:13.124230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:13.219465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f971d88cc8444c038d9308cabec0e75b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.221266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f971d88cc8444c038d9308cabec0e75b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.240899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f971d88cc8444c038d9308cabec0e75b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.263701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f971d88cc8444c038d9308cabec0e75b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.264809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7d25182c-3bec-4463-bcc5-a50c24cb1504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f971d88cc8444c038d9308cabec0e75b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.293522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3d8321426642918f7c969c4ffa4d7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.294699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3d8321426642918f7c969c4ffa4d7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.323392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3d8321426642918f7c969c4ffa4d7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.325989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3d8321426642918f7c969c4ffa4d7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.354537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 880/1792] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:12 2022] DELETE /identity/v3/users/f971d88cc8444c038d9308cabec0e75b => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:13.358283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c6507b8b-a89f-44fb-93cc-a44b59f1a226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3d8321426642918f7c969c4ffa4d7f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:13.370674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:13.371146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:13.371524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:13.434001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 913/1793] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:12 2022] DELETE /identity/v3/users/1e3d8321426642918f7c969c4ffa4d7f => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:13.455391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:13.458846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:13.459303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:13.459695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:13.461472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:13.518977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:13.520501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:13.672354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 881/1794] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:13.745340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 914/1795] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Sep 19 11:15:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:13.759448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:13.770901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:13.788468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:13.790907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:13.812243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591ef55-72d5-4b48-bfda-5ebbac730878 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:13.816232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da385e-62bb-40e3-b5c1-61ceaa329af2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:13.826892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:13.828259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:13.828895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:13.829760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:13.841010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:13.842321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:13.844041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:13.853759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:13.855587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:13.857884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:13.888395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:13.890933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:13.896013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 915/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:13.933309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 882/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:15.793632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:15.795067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:15.834973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144baf4d-e3a9-41c6-bcc2-8523e5a5f727 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:15.862272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:15.863000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:15.863485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:15.863971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] PATH_INFO: `/v3/projects/844337ccfb724db881fa713aa7733f98` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:15.868148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844337ccfb724db881fa713aa7733f98)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:15.877400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:15.903640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:16.066116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844337ccfb724db881fa713aa7733f98', 'request_id': 'req-d5db66b8-ee40-478d-b968-8d40fbbd1764'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.088020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844337ccfb724db881fa713aa7733f98', 'request_id': 'req-d5db66b8-ee40-478d-b968-8d40fbbd1764'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.109949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844337ccfb724db881fa713aa7733f98', 'request_id': 'req-d5db66b8-ee40-478d-b968-8d40fbbd1764'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.147060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] The token cache is being invalidate because project 844337ccfb724db881fa713aa7733f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:16.147462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.148245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.152680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 916/1798] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:15 2022] DELETE /identity/v3/projects/844337ccfb724db881fa713aa7733f98 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:16.156754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:16.194828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4899c-df6c-4bfd-8317-ac1e71117c21 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:16.294771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:16.373245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:16.374249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:16.374801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:16.375349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] PATH_INFO: `/v3/users/f5e32fa8510a495996c34faaa8676f22` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:16.378536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e32fa8510a495996c34faaa8676f22)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:16.383190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:16.492435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e32fa8510a495996c34faaa8676f22'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.493942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e32fa8510a495996c34faaa8676f22'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.513833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e32fa8510a495996c34faaa8676f22'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.525951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e32fa8510a495996c34faaa8676f22'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.527393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d5ffdef0-5974-485d-b1d3-b5b78718b3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e32fa8510a495996c34faaa8676f22'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:16.555445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 883/1799] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:16 2022] DELETE /identity/v3/users/f5e32fa8510a495996c34faaa8676f22 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:17.296533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:17.298031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:17.332214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db66b8-ee40-478d-b968-8d40fbbd1764 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:17.488115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:17.489302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:17.489759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:17.490176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] PATH_INFO: `/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:17.492834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4acdb6a0ad450ba2a1791c35ad8924)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:17.501486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:17.763310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4acdb6a0ad450ba2a1791c35ad8924', 'request_id': 'req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:17.783619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4acdb6a0ad450ba2a1791c35ad8924', 'request_id': 'req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:17.796936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4acdb6a0ad450ba2a1791c35ad8924', 'request_id': 'req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:17.826274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] The token cache is being invalidate because project cd4acdb6a0ad450ba2a1791c35ad8924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:17.826726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:17.829444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9b6ba51-459e-42c1-bded-4e9e5ba1081b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:17.835502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 917/1800] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:17 2022] DELETE /identity/v3/projects/cd4acdb6a0ad450ba2a1791c35ad8924 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:17.842450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:17.843338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:17.843338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:17.912390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:17.914410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:18.109977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 884/1801] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:18.122574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.123448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.123747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.190779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:18.192417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:18.251416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:18.266779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 918/1802] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:18.267817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f998e1-ed8c-4a70-86e5-5aa3f3d2372e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:18.308352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:18.309055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.309344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.309652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.310425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:18.310746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:18.321923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:18.374201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 885/1803] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:18.379917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:18.394526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ee7fd-506a-4727-a795-9e898f7a41cc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:18.415894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:18.417844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.418468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.422501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.426609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:18.433823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:18.504618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:18.545011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 919/1804] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:18 2022] POST /identity/v3/projects => generated 407 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:18.549820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:18.569015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d1880-64e2-40d6-ba2b-8f374dad1a2b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:18.662161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:18.779630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:18.780340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.783305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.783834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.784615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:18.795616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:18.866306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:18.878813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 886/1805] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:18 2022] POST /identity/v3/users => generated 304 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:18.882968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b40841-fab1-4838-a7cf-21c64ff597fe admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:18.906178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:18.906824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.907103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.907408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.908707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:18.912128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:18.944321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 920/1806] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:18.945675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:18.974120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899c5ea-c122-4958-a7f7-c20422eda800 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:18.982017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:18.983013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:18.983686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:18.984226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:18.985182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:18.989443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:19.013076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 887/1807] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:19.017353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:19.038586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeecab8-9afc-4844-86bb-abd18f745d9e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:19.053193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:19.054199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:19.054629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:19.055054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] PATH_INFO: `/v3/projects/b2aa9d21f26446c3b4c992efdd7c2a26/users/60a20e301e434e408749b68d36dfd5d4/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:19.090231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2aa9d21f26446c3b4c992efdd7c2a26, user_id=60a20e301e434e408749b68d36dfd5d4, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:19.094301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e67e32-fc4e-44ad-971c-66f2675445d4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:19.096150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:19.098651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:19.119471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c231d3d7-e7db-4ec9-9edd-c3e4a6f8d073 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:19.161590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 921/1808] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:19 2022] PUT /identity/v3/projects/b2aa9d21f26446c3b4c992efdd7c2a26/users/60a20e301e434e408749b68d36dfd5d4/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:19.177262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:19.177488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:19.177751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:19.240902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] MFA Rules not processed for user `60a20e301e434e408749b68d36dfd5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:19.242159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:19.274685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:19.274685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:19.275393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:19.275676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] PATH_INFO: `/v3/projects/6dd9b958927f4a4a8bb40cac425f6548` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:19.277017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd9b958927f4a4a8bb40cac425f6548)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:19.279293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:19.392874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd9b958927f4a4a8bb40cac425f6548', 'request_id': 'req-aa68d19b-9e42-4c68-b326-2c555ea69ae0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:19.431376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd9b958927f4a4a8bb40cac425f6548', 'request_id': 'req-aa68d19b-9e42-4c68-b326-2c555ea69ae0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:19.448622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd9b958927f4a4a8bb40cac425f6548', 'request_id': 'req-aa68d19b-9e42-4c68-b326-2c555ea69ae0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:19.481924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 922/1809] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:19 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:19.482961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:19.518236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] The token cache is being invalidate because project 6dd9b958927f4a4a8bb40cac425f6548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:19.518540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:19.519877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:19.523898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 888/1810] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:19 2022] DELETE /identity/v3/projects/6dd9b958927f4a4a8bb40cac425f6548 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:19.536357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc646f8-b1e2-494d-bf44-c0994bf95723 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:19.565034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:19.576334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:19.696880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:19.697590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:19.697866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:19.698223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:19.698929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:19.700935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:19.768401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:19.826991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 923/1811] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:19 2022] POST /identity/v3/projects => generated 409 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:19.831462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:19.833182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:19.870407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68d19b-9e42-4c68-b326-2c555ea69ae0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:19.924127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:19.991923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8090ca3-c04a-4678-94aa-763b409b4d68 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:20.028393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.029035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.029435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.029716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.030360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.034420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.093756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.095082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.095822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.096234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] PATH_INFO: `/v3/users/81c894010759460786364263aedec50e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.097595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c894010759460786364263aedec50e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.100478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.127055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 924/1812] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:19 2022] POST /identity/v3/users => generated 311 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:20.128943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:20.212787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd60c8b-6a1f-416c-84d3-40d5c1e3e8d0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:20.240116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c894010759460786364263aedec50e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:20.241339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c894010759460786364263aedec50e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:20.248576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.249211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.249498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.252883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.253618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.260029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5b843-6a6f-407a-933f-c4c042e0e329 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.267271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c894010759460786364263aedec50e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:20.289306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c894010759460786364263aedec50e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:20.291401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c894010759460786364263aedec50e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:20.293646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 925/1813] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:20.297689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.299436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.299742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.306828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 926/1814] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:15:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:20.308087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:20.317379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:20.341478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 889/1815] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:19 2022] DELETE /identity/v3/users/81c894010759460786364263aedec50e => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:20.373564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc6c9d-c071-4997-b73a-5c5a72a632b0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:20.501639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.502382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.502687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.502907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] PATH_INFO: `/v3/projects/3a88da2d33884aa8b3d6d89a5d372257/users/0609539c8b044a7cbed2564393fcfaac/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.535045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a88da2d33884aa8b3d6d89a5d372257, user_id=0609539c8b044a7cbed2564393fcfaac, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.535045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d31669-b792-4566-b612-449c9e2170ca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.565640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 927/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:20 2022] PUT /identity/v3/projects/3a88da2d33884aa8b3d6d89a5d372257/users/0609539c8b044a7cbed2564393fcfaac/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:20.569881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:20.585999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227710b0-26a3-4a0c-a53d-a5c1beb727e7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:20.728413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.729072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.729725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.734882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.735783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.736156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.736712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.737589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.739885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.762620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 890/1817] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:20.768410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:20.773372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:20.776816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:20.807962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357565d0-5788-49b2-ad6a-69df9eb10bbe admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:20.826599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:20.827647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.830263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.830685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] PATH_INFO: `/v3/projects/3a88da2d33884aa8b3d6d89a5d372257/users/0609539c8b044a7cbed2564393fcfaac/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.837555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a88da2d33884aa8b3d6d89a5d372257, user_id=0609539c8b044a7cbed2564393fcfaac, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:20.847723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc86e-4f65-4a65-9fac-4320470991ca admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:20.854696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:20.889858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 891/1818] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:20 2022] PUT /identity/v3/projects/3a88da2d33884aa8b3d6d89a5d372257/users/0609539c8b044a7cbed2564393fcfaac/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:20.901034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:20.901331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:20.901726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:20.994960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 928/1819] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:21.017487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] MFA Rules not processed for user `0609539c8b044a7cbed2564393fcfaac`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:21.019910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:21.287720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 892/1820] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:21.365960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:21.365960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:21.447416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:21.531186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ce87-ddd3-4553-a8ee-17085d55aff1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:21.667230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:21.668034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:21.669140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:21.670572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:21.683617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:21.686325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:21.694054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:21.716234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ddbd9-b5be-4336-9896-8231f77f58f2 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:21.764155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 929/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:21 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:21.882822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46eca4-af93-47d3-a0aa-776ac2e25f68 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:21.897178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:21.897922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:21.898205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:21.898520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:21.928080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:21.929889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd75448-1d42-49d3-9e1a-78a3c691cf2d service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:22.003180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 893/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:22.105751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b5af-1cde-4d68-85b8-80d69eb05ade None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:22.106262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b5af-1cde-4d68-85b8-80d69eb05ade None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:22.106643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01b5af-1cde-4d68-85b8-80d69eb05ade None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:22.109081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 930/1823] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:15:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:22.210143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:22.210551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:22.210897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:22.273311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:22.281430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:22.287779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b5af-1cde-4d68-85b8-80d69eb05ade None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:22.311220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01b5af-1cde-4d68-85b8-80d69eb05ade None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:22.325418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:22.326504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:22.326984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:22.327895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:22.331439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:22.342183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 894/1824] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:15:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:22.562516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:22.564513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:22.596324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 931/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:22.663275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:22.666742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:22.706877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7780f6-45f7-40d6-8366-283debc15f7e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:22.732168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:22.732906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:22.733260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:22.733607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:22.759472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:22.763255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21d5186-8225-49a4-a0a3-529ee412dea6 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:22.817274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 895/1826] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:23.589081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:23.590816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:23.754431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de418e-d622-46a5-8871-44c4b34e84fa service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:23.762212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:23.763390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:23.763855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:23.764317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] PATH_INFO: `/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:23.766085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b530b7006cc4f12ae6f170c4f18f9a7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:23.769655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:23.822589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:23.882866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b530b7006cc4f12ae6f170c4f18f9a7', 'request_id': 'req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:23.891546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b530b7006cc4f12ae6f170c4f18f9a7', 'request_id': 'req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:23.904245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b530b7006cc4f12ae6f170c4f18f9a7', 'request_id': 'req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:23.934503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] The token cache is being invalidate because project 5b530b7006cc4f12ae6f170c4f18f9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:23.934818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:23.935378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ecde7cc7-2d28-4081-a7c0-6ad755ee8a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:23.937212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 932/1827] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:23 2022] DELETE /identity/v3/projects/5b530b7006cc4f12ae6f170c4f18f9a7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:23.942091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:23.942636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:23.942636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:23.970957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:23.972257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:24.045485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:24.076669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 896/1828] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:24.086031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.086643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.086963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.108835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:24.110218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:24.119348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 933/1829] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:24.123493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.134418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f1f5-ff14-4a0c-8210-30fb3e6e9bc6 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.144271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.144642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.144873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.145151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.146237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:24.146532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.148258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.164030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 897/1830] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:24.169857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.181626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae6f9-17ce-4b93-8234-a77df20c17e4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.187579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.188586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.188904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.189251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.189968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.192210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.223706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 934/1831] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:24.228537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.238438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152910c-0328-4701-8884-b7bf5084f485 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.303923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.304473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.304752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.305025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.305909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.308041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.329357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 898/1832] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:24.333454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.345838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a78c-b27c-4763-adfb-77779afc2347 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.350521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.351144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.351435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.351834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.353178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.355479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.365743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 935/1833] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:24.370029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.380755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba15899-2752-4f79-a106-46d0a3ea2a7c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.386082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.386693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.387287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.387580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.388221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.389862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497aef-55ef-4543-a201-aeca3fb4dbf2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.404813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 899/1834] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:24.409111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.420346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3619ba-fc05-4655-b0b2-16471616674b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.425064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.425729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.426018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.426410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] PATH_INFO: `/v3/projects/c1943372c5a74ae8834e3c01a50115bd/users/de458ca0aeff4b31b1dea5afed10aa74/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.442605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1943372c5a74ae8834e3c01a50115bd, user_id=de458ca0aeff4b31b1dea5afed10aa74, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.446245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.465782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 936/1835] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:24 2022] PUT /identity/v3/projects/c1943372c5a74ae8834e3c01a50115bd/users/de458ca0aeff4b31b1dea5afed10aa74/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:24.477030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.478779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.479134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.518360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] MFA Rules not processed for user `de458ca0aeff4b31b1dea5afed10aa74`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:24.520066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:24.618952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 900/1836] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:24.625752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.699094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.701185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:24.731073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fe72-9995-4b59-a577-8909446f4338 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.755329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.756208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.758260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.758937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.762959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.765305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.784998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:24.810392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 937/1837] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:24.815230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.817978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e91985-167c-4796-b72c-46f89bafad00 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.871268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:24.898231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e69ff-5081-41f4-aac1-15123043c44b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.906004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.906922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.907335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.907775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.908612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.908803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.909515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.909799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.910092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] PATH_INFO: `/v3/users/40743a8c956f41d0aefb9d064e56d794` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.911089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.911455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40743a8c956f41d0aefb9d064e56d794)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.913480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.940840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 938/1838] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:24 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:24.945837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.956375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1f848-c408-468c-a51c-38e1ac0b4dca admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.962276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.963045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.963361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.963642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:24.964289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:24.965914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:24.976131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 939/1839] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:24.976379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40743a8c956f41d0aefb9d064e56d794'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:24.979807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40743a8c956f41d0aefb9d064e56d794'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:24.981042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:24.989703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40743a8c956f41d0aefb9d064e56d794'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:24.992501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757eee9-067d-4ea8-b389-a314d7ffd874 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:24.998376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:24.999117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:24.999390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40743a8c956f41d0aefb9d064e56d794'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:24.999537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:24.999758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] PATH_INFO: `/v3/projects/51b6ce095120432eb39cda91ee0bfbed/users/004c9d38d4054da4863624782a069fc7/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.000179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28e56350-8f82-449b-888f-d5b459a6dd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40743a8c956f41d0aefb9d064e56d794'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:25.016837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b6ce095120432eb39cda91ee0bfbed, user_id=004c9d38d4054da4863624782a069fc7, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:25.019621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:25.023098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 901/1840] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:24 2022] DELETE /identity/v3/users/40743a8c956f41d0aefb9d064e56d794 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:25.025914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.026280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.026610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.038081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 940/1841] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:24 2022] PUT /identity/v3/projects/51b6ce095120432eb39cda91ee0bfbed/users/004c9d38d4054da4863624782a069fc7/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:25.041857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:25.043783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.046466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:25.047685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.172064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9c13-8c7c-4748-bd32-0ba8bb189890 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:25.194485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:25.195071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.198182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.198519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.201161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:25.206600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:25.233684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 902/1843] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:25.234192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 941/1843] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:25.247188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:25.271865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:25.274610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.279934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e173e-1751-4aa1-9357-e28a34382322 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:25.287975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:25.288816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.289107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.289380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] PATH_INFO: `/v3/projects/51b6ce095120432eb39cda91ee0bfbed/users/004c9d38d4054da4863624782a069fc7/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.299898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b6ce095120432eb39cda91ee0bfbed, user_id=004c9d38d4054da4863624782a069fc7, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:25.305233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a5230-526a-4bce-b1af-813cf48e62b7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:25.309355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:25.347721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 903/1844] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:25 2022] PUT /identity/v3/projects/51b6ce095120432eb39cda91ee0bfbed/users/004c9d38d4054da4863624782a069fc7/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:25.358855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.359248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.360596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.409312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] MFA Rules not processed for user `004c9d38d4054da4863624782a069fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:25.410654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.428688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32a157-61c4-438b-9c3e-a4d236e0dfeb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:25.494845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:25.514915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:25.515583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.515847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.516092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.527843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 904/1845] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:25.540481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:25.542587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.600080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:25.601452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:25.613242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9946746-e4a8-4deb-8bb0-fcc22cfb420b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:25.615327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 942/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:25.620158 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:25.621144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:25.621665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:25.622143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:25.624518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:25.691051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:25.693050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:25.707477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 905/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:26.418905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:26.423034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.443439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeec16-571d-4d26-9a4d-ce96b72f7d80 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:26.450091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:26.451047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.451395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.451794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] PATH_INFO: `/v3/users/fe37b823532049e9a86cd6fe4d8f5822` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.453416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe37b823532049e9a86cd6fe4d8f5822)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:26.468372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:26.545129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe37b823532049e9a86cd6fe4d8f5822'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.545918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe37b823532049e9a86cd6fe4d8f5822'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.560975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:26.562744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.578816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe37b823532049e9a86cd6fe4d8f5822'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.579697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe37b823532049e9a86cd6fe4d8f5822'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.594643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860701-d966-4bba-be6e-a9f9d06ff70c service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:26.600400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:26.601235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.601628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.601951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] PATH_INFO: `/v3/projects/1aa4db3596dd4fe7983019a6a1d4e028` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.604433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa4db3596dd4fe7983019a6a1d4e028)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:26.606979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-677f87a2-5f2e-41b3-b14d-60a0206442ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe37b823532049e9a86cd6fe4d8f5822'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.608882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:26.630081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 943/1848] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:26 2022] DELETE /identity/v3/users/fe37b823532049e9a86cd6fe4d8f5822 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:26.634949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.635330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.635725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.667446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:26.667713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:26.668952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.704712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa4db3596dd4fe7983019a6a1d4e028', 'request_id': 'req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.715731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa4db3596dd4fe7983019a6a1d4e028', 'request_id': 'req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.726701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa4db3596dd4fe7983019a6a1d4e028', 'request_id': 'req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.742710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] The token cache is being invalidate because project 1aa4db3596dd4fe7983019a6a1d4e028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:26.743109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.743927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.745666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 906/1849] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:26 2022] DELETE /identity/v3/projects/1aa4db3596dd4fe7983019a6a1d4e028 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:26.749304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:26.751111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.761319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 944/1850] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:26.770827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:26.772261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:26.783526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:26.830439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef392-5d6c-4e67-bf79-6a0aa73d187c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:26.835712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:26.837600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.838055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.838341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] PATH_INFO: `/v3/users/30104451af9c4975af6bc6651467e617` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.839727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30104451af9c4975af6bc6651467e617)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:26.841370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5396cf-e901-4e9e-9b29-1370b691e985 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:26.841486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:26.930143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30104451af9c4975af6bc6651467e617'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.932285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30104451af9c4975af6bc6651467e617'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.948037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30104451af9c4975af6bc6651467e617'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.958410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:26.959341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:26.959578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:26.960012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:26.960462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30104451af9c4975af6bc6651467e617'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.961478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30104451af9c4975af6bc6651467e617'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:26.983368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:26.984981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:26.986404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 907/1851] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:26 2022] DELETE /identity/v3/users/30104451af9c4975af6bc6651467e617 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:26.999558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 945/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:27.232278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.234083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.289414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:27.315360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e145773-26a4-4e3b-aede-00a4260c3081 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.319384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.319877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.320946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.320946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.324241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.369917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.403789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb35ff-5e53-4580-b119-d0abee151350 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.417232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.418784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.429946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 908/1853] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:27.430710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.432213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.503619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.506253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.506253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.506253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] PATH_INFO: `/v3/projects/8b3ad07422db46f08701a77f3864bf20` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.507494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3ad07422db46f08701a77f3864bf20)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.509840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.528486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d069c4-6d85-4e58-b539-9dddfa043317 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.535547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.536244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.536580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.536910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] PATH_INFO: `/v3/projects/c91c9bd864f443c48671c53fc300bf3c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.538450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91c9bd864f443c48671c53fc300bf3c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.542037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.580047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3ad07422db46f08701a77f3864bf20', 'request_id': 'req-4858d406-74fd-4682-8577-53ef099a622c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.587838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3ad07422db46f08701a77f3864bf20', 'request_id': 'req-4858d406-74fd-4682-8577-53ef099a622c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.601231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3ad07422db46f08701a77f3864bf20', 'request_id': 'req-4858d406-74fd-4682-8577-53ef099a622c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.609377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:27.648471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] The token cache is being invalidate because project 8b3ad07422db46f08701a77f3864bf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:27.649737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.650140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4858d406-74fd-4682-8577-53ef099a622c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.652139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 946/1854] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:27 2022] DELETE /identity/v3/projects/8b3ad07422db46f08701a77f3864bf20 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:27.657763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523592-f740-4b64-b118-8d093bb3a04e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.657945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523592-f740-4b64-b118-8d093bb3a04e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.659055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523592-f740-4b64-b118-8d093bb3a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.695894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91c9bd864f443c48671c53fc300bf3c', 'request_id': 'req-50b96029-b05b-4716-9787-2aeb5270fea7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.699790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ba523592-f740-4b64-b118-8d093bb3a04e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:27.702678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ba523592-f740-4b64-b118-8d093bb3a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.713450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91c9bd864f443c48671c53fc300bf3c', 'request_id': 'req-50b96029-b05b-4716-9787-2aeb5270fea7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.733256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91c9bd864f443c48671c53fc300bf3c', 'request_id': 'req-50b96029-b05b-4716-9787-2aeb5270fea7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.764098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] The token cache is being invalidate because project c91c9bd864f443c48671c53fc300bf3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:27.764916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.765808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.768850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 909/1855] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:27 2022] DELETE /identity/v3/projects/c91c9bd864f443c48671c53fc300bf3c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:27.773899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.776733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.802725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:27.809468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 947/1856] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:27.823014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.823483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.824331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.857853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:27.859617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:27.868749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96029-b05b-4716-9787-2aeb5270fea7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.875641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.880405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 948/1857] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:27.881574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.882462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.882462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.882869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] PATH_INFO: `/v3/users/afd367d11d6f4082a8c1248036fe86f5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.884728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd367d11d6f4082a8c1248036fe86f5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.886876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.896005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23001b91-230d-4c01-98a9-6ea0bf8aba27 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.908132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.908905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.909254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.909604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.910401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:27.910782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.913170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.935071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 949/1858] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:27.936604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:27.949280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09ab9-9b3b-4b4a-8f0c-99955d75f64c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:27.956308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:27.957104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:27.958003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:27.958003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:27.958714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:27.961162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:27.969650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd367d11d6f4082a8c1248036fe86f5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.970917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd367d11d6f4082a8c1248036fe86f5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.983433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd367d11d6f4082a8c1248036fe86f5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.996155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd367d11d6f4082a8c1248036fe86f5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:27.997485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd367d11d6f4082a8c1248036fe86f5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.006336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 950/1859] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:27 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:28.012904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.015255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.029474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 910/1860] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:27 2022] DELETE /identity/v3/users/afd367d11d6f4082a8c1248036fe86f5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:28.136917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522562d8-c81f-43d0-b3fd-f935a774b0de admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.257077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.257708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.258315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.258714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.259717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.261686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.272382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:28.296648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 951/1861] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/users => generated 285 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:28.297628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.308926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc17fe-9d55-46c0-acc5-bd13365cb7c2 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.314741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.315477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.315852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.316192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.316903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.318681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.331976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 911/1862] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:28.340954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.358706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5387-269f-4590-a847-23c61c6642a3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.375220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.376513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.376992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.377470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.378392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.385928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.427304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 952/1863] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:28.442940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.470247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe5e3-86b5-4352-bd6c-0d33d8d913d6 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.473607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.481643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.482734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.482734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.483567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] PATH_INFO: `/v3/projects/aff1cdb49fd841988fc93b815ea8ae83/users/90f785c34a6346ada7a6060fe66f78e5/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.485076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.513068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a062a9-8212-4506-9798-ecf0acfb0bd8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.518451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff1cdb49fd841988fc93b815ea8ae83, user_id=90f785c34a6346ada7a6060fe66f78e5, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.519429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.520066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.520347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.521165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] PATH_INFO: `/v3/projects/a6d0d81e8ff24a5fb75a616f476479db` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.521764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d0d81e8ff24a5fb75a616f476479db)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.522444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed5cb-88b0-4215-984e-bfb7c400e235 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.523755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.539194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 912/1864] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:28 2022] PUT /identity/v3/projects/aff1cdb49fd841988fc93b815ea8ae83/users/90f785c34a6346ada7a6060fe66f78e5/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:28.550102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.550541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.550913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.578932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d0d81e8ff24a5fb75a616f476479db', 'request_id': 'req-a9a91be0-105a-4c1c-8da3-447d8a85b595'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.583882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] MFA Rules not processed for user `90f785c34a6346ada7a6060fe66f78e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:28.585227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.585384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d0d81e8ff24a5fb75a616f476479db', 'request_id': 'req-a9a91be0-105a-4c1c-8da3-447d8a85b595'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.596765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d0d81e8ff24a5fb75a616f476479db', 'request_id': 'req-a9a91be0-105a-4c1c-8da3-447d8a85b595'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.612267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] The token cache is being invalidate because project a6d0d81e8ff24a5fb75a616f476479db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:28.613086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.613677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a9a91be0-105a-4c1c-8da3-447d8a85b595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:28.619422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 953/1865] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:28 2022] DELETE /identity/v3/projects/a6d0d81e8ff24a5fb75a616f476479db => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:28.621510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222141-a168-481e-a7d4-1e239d8a0743 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.621810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222141-a168-481e-a7d4-1e239d8a0743 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.622077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7222141-a168-481e-a7d4-1e239d8a0743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.638961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:28.647998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b7222141-a168-481e-a7d4-1e239d8a0743 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:28.650193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b7222141-a168-481e-a7d4-1e239d8a0743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.666715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 913/1866] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:28.671852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.673258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.747054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 954/1867] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:28.750361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.750656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.750937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.770232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1eed-eae3-413b-9c3b-3d2ff0f1b014 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.772848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:28.775317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.776032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.776651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.776937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.777211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.777907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.780355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.788382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 955/1868] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:28.789997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.802085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8c31c-3a6c-438c-951d-98d7dce251e3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.809412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.810334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.810722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.810933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.812003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:28.812216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.813863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.825967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 914/1869] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:28.827032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.833486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 956/1870] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:28.834404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.846980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136d4f8-3cda-436b-b57d-fd646e2a38da admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.904912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:28.916067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf824c0-a96c-4b09-8b12-00420a87769f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.923268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.924227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.924466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.924808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.925566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.928101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.949478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.950358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.950682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.951112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.951948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.954343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:28.960986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 915/1871] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:28.963378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.965809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:28.981097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54272-dbea-4250-b6bc-108de4f3b6a5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:28.987705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:28.988280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:28.988550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:28.988811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] PATH_INFO: `/v3/users/60a20e301e434e408749b68d36dfd5d4` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:28.991272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 957/1872] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:28 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:28.991272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:28.991909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a20e301e434e408749b68d36dfd5d4)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:28.996254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.057666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a20e301e434e408749b68d36dfd5d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:29.058467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a20e301e434e408749b68d36dfd5d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:29.069207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a20e301e434e408749b68d36dfd5d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:29.075574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:29.079204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a20e301e434e408749b68d36dfd5d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:29.080513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a20e301e434e408749b68d36dfd5d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:29.097873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6299b1-f637-47f9-8c09-53b8451459f0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.101407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 916/1873] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:28 2022] DELETE /identity/v3/users/60a20e301e434e408749b68d36dfd5d4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:29.102740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.103908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.104507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.104909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.105469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.105963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.106740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.108327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d312f-a7d5-45e1-91f3-a5204de2d40d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.119258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 958/1874] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:29.120568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.120858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.121130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.142819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:29.144069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.181163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b5249-7dec-4e1d-904f-14cc742e637f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.187567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.188271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.188633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.189013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.190826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.191862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.222415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 959/1875] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:29.223640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.226919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 917/1876] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:29 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:29.228224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.228637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.240478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fc4df-485a-4b61-bb53-c992cf78a0ce admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.243904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296f36-efd7-4f0c-bb94-2926a259418d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.247304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.248058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.248463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.248848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.249668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.251084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.251660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.251871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.252153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.252420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] PATH_INFO: `/v3/projects/1de5998565a44bc085447a5518b4ad75/users/b65cf05be8e94a299c3c16eb5632f8a9/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.267320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 918/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:29.268360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.270490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.272153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5998565a44bc085447a5518b4ad75, user_id=b65cf05be8e94a299c3c16eb5632f8a9, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.274994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.298547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 960/1878] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:29 2022] PUT /identity/v3/projects/1de5998565a44bc085447a5518b4ad75/users/b65cf05be8e94a299c3c16eb5632f8a9/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:29.298547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.356643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:29.360599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e05d03-9e92-49e7-9a09-5b5193ab0b2a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.386433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08809004-142d-4150-909a-352ccd1cbfcd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.392145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.392817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.393325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.394025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.394747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.396855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.413461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 961/1879] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:29.413461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.426268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cb9e4-164b-4fb1-953e-cb4656c1a286 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.431482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.432518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.433013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.433507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.434512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.436280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.450674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.454710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 962/1880] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:29.454883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.454883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.454883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.457260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.471600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.472835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c50dce-151d-4d24-91ac-1640721ede40 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.473306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.480095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.481120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.481406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.481688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] PATH_INFO: `/v3/projects/e70bc9e116ec4c76acb9d350b80e8a1d/users/4ffa9c4912c44509b45b5ed8080e15a5/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.487209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 919/1881] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:29.488575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.502421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3019ce-cb73-4a78-bb2e-b6ea54101cb4 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.503183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70bc9e116ec4c76acb9d350b80e8a1d, user_id=4ffa9c4912c44509b45b5ed8080e15a5, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.508219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb37982-a090-48e1-92cc-0b06eae37da2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.510780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.511617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.512001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.512372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] PATH_INFO: `/v3/projects/1de5998565a44bc085447a5518b4ad75/users/b65cf05be8e94a299c3c16eb5632f8a9/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.514588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5998565a44bc085447a5518b4ad75, user_id=b65cf05be8e94a299c3c16eb5632f8a9, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.518172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198dd7f-9bbd-4c68-acec-7fe9cab4c8f3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:29.527425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:29.541194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 920/1882] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:29 2022] PUT /identity/v3/projects/1de5998565a44bc085447a5518b4ad75/users/b65cf05be8e94a299c3c16eb5632f8a9/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:29.551355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010004-a9de-423b-9236-c9ca07937952 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.551620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010004-a9de-423b-9236-c9ca07937952 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.553856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66010004-a9de-423b-9236-c9ca07937952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.560814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 963/1883] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:29 2022] PUT /identity/v3/projects/e70bc9e116ec4c76acb9d350b80e8a1d/users/4ffa9c4912c44509b45b5ed8080e15a5/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:29.572367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.572658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.572938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.616026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] MFA Rules not processed for user `4ffa9c4912c44509b45b5ed8080e15a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:29.617407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.656529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-66010004-a9de-423b-9236-c9ca07937952 None None] MFA Rules not processed for user `b65cf05be8e94a299c3c16eb5632f8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:29.658074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-66010004-a9de-423b-9236-c9ca07937952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.753071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 964/1884] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:29.757832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.847647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 921/1885] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:29.862814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66010004-a9de-423b-9236-c9ca07937952 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:29.866652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-66010004-a9de-423b-9236-c9ca07937952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:29.926852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f58e72-0d4c-4690-89e7-cafb9bd21ce4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:29.945628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:29.946881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:29.947266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:29.951984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:29.952987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:29.960258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.015096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66010004-a9de-423b-9236-c9ca07937952 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.026734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 965/1886] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:29 2022] POST /identity/v3/projects => generated 365 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:30.027039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.027039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.027039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.027039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.028079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.046633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.048172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc07b3e-22f8-4beb-a3a7-96cb0b40c2c1 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.050727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:30.059808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 922/1887] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:30.109923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb172-72e3-459e-8114-0fe8caba4870 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.109923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb172-72e3-459e-8114-0fe8caba4870 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.109923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eb172-72e3-459e-8114-0fe8caba4870 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.110904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 923/1888] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:15:30.130381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.130678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.130958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.134776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576d03-e568-4461-8193-dcb695617a1a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.155760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:30.156605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.156993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:30.157280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.157563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.157956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.158614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.160818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.244085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 966/1889] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:30 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:30.246983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.290378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 924/1890] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:15:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:30.291313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.324235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdffb32-bcf2-4dbc-8319-9106da3181e5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.337093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.337728 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.339139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.339440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.340099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.341737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.375106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 925/1891] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:30.376079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.382613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:30.402644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcaff8-3991-4456-8f1f-4b919d455e9a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.411193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.413028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.413583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.413583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.419236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de57b95-8a54-4bba-8c3d-d9a225e1f810 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.420327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:30.436813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.437401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.437689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.437966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.461166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:30.475228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.478458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.494426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 926/1892] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:30.507466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.551083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284d094-f3f7-4d80-bbf9-bd49341cee06 service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.561833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.562507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.562913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.563220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] PATH_INFO: `/v3/projects/644800ab4f7645fb95aad535e7e0babe/users/9cd9cbee2b7b4287b2647d473a57af0d/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.582860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=644800ab4f7645fb95aad535e7e0babe, user_id=9cd9cbee2b7b4287b2647d473a57af0d, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.586403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.619479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 927/1893] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:30 2022] PUT /identity/v3/projects/644800ab4f7645fb95aad535e7e0babe/users/9cd9cbee2b7b4287b2647d473a57af0d/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:30.621671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.624765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:30.626287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.631532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.688993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 967/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:30.690945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.709279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea3123-00f7-481e-b04e-a2481f0a04ed service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.846083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a956c0c-e8bc-44c2-a0f0-27b686993e8e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.856198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.857325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.857690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.858109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] PATH_INFO: `/v3/projects/b2aa9d21f26446c3b4c992efdd7c2a26` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.861370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2aa9d21f26446c3b4c992efdd7c2a26)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.870754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.885908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.886746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.887069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.887400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.888584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.890706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.893838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:30.905608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 968/1895] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:30.911295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:30.925939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70d404-4813-4d81-8ca4-f3cbd94e4bc5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:30.932942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:30.933770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.934130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.934883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] PATH_INFO: `/v3/projects/644800ab4f7645fb95aad535e7e0babe/users/9cd9cbee2b7b4287b2647d473a57af0d/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.937524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=644800ab4f7645fb95aad535e7e0babe, user_id=9cd9cbee2b7b4287b2647d473a57af0d, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:30.941159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9822-368b-4720-a690-a17b21d43801 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:30.968262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 969/1896] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:30 2022] PUT /identity/v3/projects/644800ab4f7645fb95aad535e7e0babe/users/9cd9cbee2b7b4287b2647d473a57af0d/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:30.971262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:30.971561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:30.971986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:30.996235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2aa9d21f26446c3b4c992efdd7c2a26', 'request_id': 'req-b0a086e9-114e-46ec-8262-72bba586948d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.007623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2aa9d21f26446c3b4c992efdd7c2a26', 'request_id': 'req-b0a086e9-114e-46ec-8262-72bba586948d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.013871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] MFA Rules not processed for user `9cd9cbee2b7b4287b2647d473a57af0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:31.015463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:31.031680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2aa9d21f26446c3b4c992efdd7c2a26', 'request_id': 'req-b0a086e9-114e-46ec-8262-72bba586948d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.065086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] The token cache is being invalidate because project b2aa9d21f26446c3b4c992efdd7c2a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:31.065741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.066998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.083104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 928/1897] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:30 2022] DELETE /identity/v3/projects/b2aa9d21f26446c3b4c992efdd7c2a26 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:31.088993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.091379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:31.198290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 970/1898] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:31.208512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.213252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:31.303549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a086e9-114e-46ec-8262-72bba586948d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.316068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.316799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.317086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.317387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] PATH_INFO: `/v3/users/0609539c8b044a7cbed2564393fcfaac` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.319780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0609539c8b044a7cbed2564393fcfaac)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.324173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.327620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:31.372802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e18e78-a781-4cb6-97b3-0f48225e74dd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.378727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.383141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.385571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.385922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.413212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.416730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.425581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0609539c8b044a7cbed2564393fcfaac'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.426366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0609539c8b044a7cbed2564393fcfaac'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.442079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 971/1899] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:31.443897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0609539c8b044a7cbed2564393fcfaac'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.454060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0609539c8b044a7cbed2564393fcfaac'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.454819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0609539c8b044a7cbed2564393fcfaac'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:31.486396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 929/1900] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:31 2022] DELETE /identity/v3/users/0609539c8b044a7cbed2564393fcfaac => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:31.584760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.599727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf99cf-fc9a-440a-af7d-e10d93a27707 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.701302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.702056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.702872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.703284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.705938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:31.745796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:31.793345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.795514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:31.815530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:31.817275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:31.831439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 972/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:31.941584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68470dd-0322-4345-afdb-0442b0c59979 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:31.949645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:31.951237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:31.951687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:31.953004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] PATH_INFO: `/v3/users/de458ca0aeff4b31b1dea5afed10aa74` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:31.955326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de458ca0aeff4b31b1dea5afed10aa74)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:31.958359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.040987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de458ca0aeff4b31b1dea5afed10aa74'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.042007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de458ca0aeff4b31b1dea5afed10aa74'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.052289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de458ca0aeff4b31b1dea5afed10aa74'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.066878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de458ca0aeff4b31b1dea5afed10aa74'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.067982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-655a7ba0-605d-4bd9-8680-4219f32021b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de458ca0aeff4b31b1dea5afed10aa74'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.092654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.100656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 930/1902] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:31 2022] DELETE /identity/v3/users/de458ca0aeff4b31b1dea5afed10aa74 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:32.104784 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.106591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.119436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.119851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.121190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.140352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb103-b7ad-445b-8b63-edb228d71025 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.167765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:32.173668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.292981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.293764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.293948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.294200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] PATH_INFO: `/v3/projects/3a88da2d33884aa8b3d6d89a5d372257` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.299032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a88da2d33884aa8b3d6d89a5d372257)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.303824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.384214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 931/1903] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:32.398461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.404087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.433908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a88da2d33884aa8b3d6d89a5d372257', 'request_id': 'req-54f86c28-3668-4aab-8044-b7f2622af035'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.451536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a88da2d33884aa8b3d6d89a5d372257', 'request_id': 'req-54f86c28-3668-4aab-8044-b7f2622af035'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.461190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a88da2d33884aa8b3d6d89a5d372257', 'request_id': 'req-54f86c28-3668-4aab-8044-b7f2622af035'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.482560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] The token cache is being invalidate because project 3a88da2d33884aa8b3d6d89a5d372257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:32.483177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.484096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-54f86c28-3668-4aab-8044-b7f2622af035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:32.487650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 973/1904] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:32 2022] DELETE /identity/v3/projects/3a88da2d33884aa8b3d6d89a5d372257 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:32.492188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd3d9-013f-497d-810a-298c5d826eed None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.492475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd3d9-013f-497d-810a-298c5d826eed None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.492799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271dd3d9-013f-497d-810a-298c5d826eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.529619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-271dd3d9-013f-497d-810a-298c5d826eed None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:32.532308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-271dd3d9-013f-497d-810a-298c5d826eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.547884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad39993-e960-4a38-baef-973e74764fb9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.673455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:32.678151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.678973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.679479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.679751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.688102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.693816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 974/1905] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:32.703120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.703747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.703747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.714131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.717528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.750440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 932/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:32.753579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:32.755095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:32.765724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 975/1907] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:32.770038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.782868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5adc3-5029-41a2-b953-3d1bc1a682da service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.788126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.791625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.792410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.793060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.794110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:32.794516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.796912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.833164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.841449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 933/1908] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:32.849436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd539-0bab-4853-9cf3-c88af0e7241b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:32.865399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:32.869113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:32.870040 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:32.871664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:32.874396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:32.879821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:32.975243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 976/1909] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:32 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:32.979263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:32.994042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014eed-1a8f-45d9-b76b-4c7072327b06 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.106679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:33.153624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.154397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.154765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.155130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.156098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.159367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.203391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 934/1910] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:32 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:33.203655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.226534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e426a-d837-42ff-97d0-d9ce16034db7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.235802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.236617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.237002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.237372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.238170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.240457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.255446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 977/1911] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:33.260170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.271691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c26ea-893f-42f1-9006-849f670eb0bb admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.286269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.287599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.290109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.290109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.290953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.293256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.308409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 935/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:33.309667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.324251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8126a-238e-419b-a975-7bbea333658f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.329496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.330179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.330462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.330744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] PATH_INFO: `/v3/projects/391cdf3278e6449cb3a64da3dee76175/users/b7173886bd94443fba115e55712aff6f/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.366951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=391cdf3278e6449cb3a64da3dee76175, user_id=b7173886bd94443fba115e55712aff6f, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.370983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ad40d-24f3-4c9a-90d9-a43959d5dadf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.387720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.393489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.410948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 978/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:33 2022] PUT /identity/v3/projects/391cdf3278e6449cb3a64da3dee76175/users/b7173886bd94443fba115e55712aff6f/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:33.418887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7e366-ed02-40ed-b64b-097892e9b519 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.434682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.434973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.439301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.474355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] MFA Rules not processed for user `b7173886bd94443fba115e55712aff6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:33.476120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.531883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.532548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.532831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.533109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] PATH_INFO: `/v3/projects/c1943372c5a74ae8834e3c01a50115bd` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.534340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1943372c5a74ae8834e3c01a50115bd)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.536329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.580983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 979/1914] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:33.594501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.599095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.600480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1943372c5a74ae8834e3c01a50115bd', 'request_id': 'req-fa072685-5ee4-4111-917e-56fe5dffc083'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.609567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1943372c5a74ae8834e3c01a50115bd', 'request_id': 'req-fa072685-5ee4-4111-917e-56fe5dffc083'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.622877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1943372c5a74ae8834e3c01a50115bd', 'request_id': 'req-fa072685-5ee4-4111-917e-56fe5dffc083'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.639473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] The token cache is being invalidate because project c1943372c5a74ae8834e3c01a50115bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:33.644899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.645672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.650838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 936/1915] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:33 2022] DELETE /identity/v3/projects/c1943372c5a74ae8834e3c01a50115bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:33.653356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.656245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.710575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff957fd1-6bc3-44a0-a0fa-b54791d59ee0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.780638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:33.791113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:33.798437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa072685-5ee4-4111-917e-56fe5dffc083 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:33.808871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.810131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.810882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.812101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.813548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:33.814630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:33.815259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:33.816158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.817636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] PATH_INFO: `/v3/users/004c9d38d4054da4863624782a069fc7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:33.819585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004c9d38d4054da4863624782a069fc7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.822547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.930284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:33.932304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:33.935497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004c9d38d4054da4863624782a069fc7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.937175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004c9d38d4054da4863624782a069fc7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.949816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004c9d38d4054da4863624782a069fc7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.953779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 980/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:33.960649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004c9d38d4054da4863624782a069fc7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.962160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f0119cf-4a96-455d-8538-6fcd590a6ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004c9d38d4054da4863624782a069fc7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:33.986103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:33.987780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:33.989137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 937/1917] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:33 2022] DELETE /identity/v3/users/004c9d38d4054da4863624782a069fc7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:34.006003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b111e-1dd1-405a-8c47-0ecaf70b4308 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:34.078230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:34.078890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.079472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.079939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] PATH_INFO: `/v3/users/b7173886bd94443fba115e55712aff6f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.082620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7173886bd94443fba115e55712aff6f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:34.084921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:34.159546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7173886bd94443fba115e55712aff6f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.160420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7173886bd94443fba115e55712aff6f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.169759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7173886bd94443fba115e55712aff6f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.171123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7173886bd94443fba115e55712aff6f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.195731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7173886bd94443fba115e55712aff6f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.239947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 981/1918] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:33 2022] DELETE /identity/v3/users/b7173886bd94443fba115e55712aff6f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:34.244391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.244684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.244964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.300268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:34.311606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:34.397012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 938/1919] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:34.416827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:34.418681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:34.435585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:34.503204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:34.504985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:34.521639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29458b55-267a-4a6d-b851-fe3d4f726c71 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:34.531568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91cda2-82b3-409b-9b70-322c79aaf31e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:34.536697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:34.537378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.537658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.537931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.538294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:34.539218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.539698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.540700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] PATH_INFO: `/v3/projects/51b6ce095120432eb39cda91ee0bfbed` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.542538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b6ce095120432eb39cda91ee0bfbed)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:34.544875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:34.550189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:34.552524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63324b-fb2a-45cc-b980-fa5fb8bc6796 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:34.567202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 982/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:34.634346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b6ce095120432eb39cda91ee0bfbed', 'request_id': 'req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.666473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b6ce095120432eb39cda91ee0bfbed', 'request_id': 'req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.673125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b6ce095120432eb39cda91ee0bfbed', 'request_id': 'req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.684753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:34.692084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] The token cache is being invalidate because project 51b6ce095120432eb39cda91ee0bfbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:34.692623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.693901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e27c45c4-9ea8-4389-b4f7-cdd0283e723b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:34.696715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 939/1921] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:34 2022] DELETE /identity/v3/projects/51b6ce095120432eb39cda91ee0bfbed => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:34.702655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.702954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.703309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.730717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:34.732083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:34.898626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 983/1922] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:34.909311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:34.909809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:34.910370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:34.948779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:34.950229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:34.970150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 940/1923] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:34.970725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:34.987026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:34.991370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.001799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d0272-adfc-4fd4-81a2-41ac91b5522f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.015141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3515c-49aa-4c93-a762-65c05c3c375e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.016732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.026312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.031321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.032122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.033060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:35.033795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.036118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.037582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.038316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.038680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.039063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] PATH_INFO: `/v3/projects/391cdf3278e6449cb3a64da3dee76175` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.041114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=391cdf3278e6449cb3a64da3dee76175)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.043863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.070000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 984/1924] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:35.071904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.074128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.095324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89000-b4bc-4f36-9c4f-b09dca330241 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.101083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.103494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.103956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.104299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] PATH_INFO: `/v3/users/90f785c34a6346ada7a6060fe66f78e5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.105855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f785c34a6346ada7a6060fe66f78e5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.108635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.146607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391cdf3278e6449cb3a64da3dee76175', 'request_id': 'req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.158752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391cdf3278e6449cb3a64da3dee76175', 'request_id': 'req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.173408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391cdf3278e6449cb3a64da3dee76175', 'request_id': 'req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.200234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] The token cache is being invalidate because project 391cdf3278e6449cb3a64da3dee76175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:35.200606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.202936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.205071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 941/1925] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:34 2022] DELETE /identity/v3/projects/391cdf3278e6449cb3a64da3dee76175 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:35.206024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.208754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f785c34a6346ada7a6060fe66f78e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.211660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.212986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f785c34a6346ada7a6060fe66f78e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.229129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f785c34a6346ada7a6060fe66f78e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.230927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f785c34a6346ada7a6060fe66f78e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.250556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8b30d13a-ef4e-4e44-855b-a1e96e9af3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f785c34a6346ada7a6060fe66f78e5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:35.303447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 985/1926] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:35 2022] DELETE /identity/v3/users/90f785c34a6346ada7a6060fe66f78e5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:35.306027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.306552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.307272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.342290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:35.344911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.375486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c5771-fc91-48c4-8ee3-7d2947ccfcf4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.379987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:35.460331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.461165 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.462133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.464896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.465629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.468215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aea485-d099-4db5-95cd-7aa981e6bf12 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.516190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 942/1927] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/projects => generated 381 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:35.521879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797f69-5c89-451e-a01f-db1e4adf4a89 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.524539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797f69-5c89-451e-a01f-db1e4adf4a89 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.525401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797f69-5c89-451e-a01f-db1e4adf4a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.563197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 986/1928] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:35.563197 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.563788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:35.563953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.574902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-9c797f69-5c89-451e-a01f-db1e4adf4a89 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:35.576892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9c797f69-5c89-451e-a01f-db1e4adf4a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.588023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd10d-3721-4508-bd1a-24cd173f4c21 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.698597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 943/1929] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:35.700563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.701056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.701452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.717158 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.717983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.718326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.718612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.719305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.721579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.747907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:35.753024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.756278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 987/1930] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:35.760847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.767648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:35.772362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 944/1931] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:35.774155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.797519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391602c-b6dc-44f8-866e-f8facc04cda0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.812706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.813342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.813623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.813951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.814610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.816278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.847266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 945/1932] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:35.848752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.874441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e8ca9-0daf-48c0-8123-3d5587e7b2dc admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.889139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.889139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.889139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.889139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.889630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:35.889630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.894704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.905177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e67cf-486e-44cc-ba21-8997da01abeb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.915720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.916378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.916710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.916992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.923683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 946/1933] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:35.924684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.935261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.936655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.939341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85009aa-1adc-443c-a260-e4525483742f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:35.944587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:35.945428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:35.946131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:35.946553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:35.947382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:35.949190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:35.961430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 988/1934] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:35.962334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 947/1935] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:35.967965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:35.969354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.000694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3fc32-4bc0-48fc-8746-a31c0225332b service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.001826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e679d-61a2-445a-964d-3348ba69d808 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.010924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.011617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.011900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.012176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.012860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.014833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.017448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.020364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.020668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.022866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] PATH_INFO: `/v3/projects/fa7780bd7ed14021a3bec2b4a776d258/users/3ad610f7f4d54d258f0311b781afcab4/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.082661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7780bd7ed14021a3bec2b4a776d258, user_id=3ad610f7f4d54d258f0311b781afcab4, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.086388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 989/1936] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:36.090713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1619a2-f9c2-4f7b-a1cb-077f26eb5822 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.093190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.124115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 948/1937] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:35 2022] PUT /identity/v3/projects/fa7780bd7ed14021a3bec2b4a776d258/users/3ad610f7f4d54d258f0311b781afcab4/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:36.136372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.138161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.138502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.183912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.224329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] MFA Rules not processed for user `3ad610f7f4d54d258f0311b781afcab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:36.225603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:36.248534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0bc4-6655-436a-8e7f-14303c2299fd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.335338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 949/1938] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:36.340604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.362385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.363440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.363726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.364350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.364992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.367967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.397793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.445851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 990/1939] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:36 2022] POST /identity/v3/users => generated 287 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:36.451915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.455587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b5913-b12e-4c36-8540-cbe5d72ae56b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.462060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.463381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.463381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.463634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.464349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.466973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.474876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f671a-2c31-4b74-8444-cd432b1f6e15 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.490826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.491505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.492015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.492378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.494049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.495960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.512910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 991/1940] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:36.514072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.516529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:36.521049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 950/1941] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:36 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:36.522911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.538624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389897a3-01bc-4db6-bf06-0cf509e59bb6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.599313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d457e18-5bb6-4be9-8059-ca93c89d7c21 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.605552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.606272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.606555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.606825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.607490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.611624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.611745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.611835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.611835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.611835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] PATH_INFO: `/v3/projects/aff1cdb49fd841988fc93b815ea8ae83` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.611835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff1cdb49fd841988fc93b815ea8ae83)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.613361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.624227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 951/1942] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:36.624227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.635931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e031c-5c0e-4cde-9ee9-9053b9161251 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.641296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.642085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.642365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.642639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.643458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.645467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.670063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 952/1943] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:36 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:36.670959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.672404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff1cdb49fd841988fc93b815ea8ae83', 'request_id': 'req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:36.681884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.683869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fe542-e97d-4d77-93a4-ecc4fcf64075 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.689026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff1cdb49fd841988fc93b815ea8ae83', 'request_id': 'req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:36.699404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff1cdb49fd841988fc93b815ea8ae83', 'request_id': 'req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:36.716641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] The token cache is being invalidate because project aff1cdb49fd841988fc93b815ea8ae83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:36.717329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:36.717762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:36.722532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 992/1944] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:36 2022] DELETE /identity/v3/projects/aff1cdb49fd841988fc93b815ea8ae83 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:36.722532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.722532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:36.764901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.765599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.765880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.766157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] PATH_INFO: `/v3/projects/0ed321a0789943fa8013b7d8c0901fe6/users/5096cc9d086d4e778e0642f3f364e8d1/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.783788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ed321a0789943fa8013b7d8c0901fe6, user_id=5096cc9d086d4e778e0642f3f364e8d1, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.789834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.804299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa32bd0-71aa-4cbb-b28f-0dbe31fa677d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.810038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 953/1945] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:36 2022] PUT /identity/v3/projects/0ed321a0789943fa8013b7d8c0901fe6/users/5096cc9d086d4e778e0642f3f364e8d1/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:36.811112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:36.813192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:36.844676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:36.910367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.912236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.912442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.912734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.914906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.917426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371b38c-586e-4d79-ac33-5b1e7bc055aa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.931313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec29ddf-1b2e-4835-b3f7-c4c9833815dd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:36.935304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 993/1946] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:36.935304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.935304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.935304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.939625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:36.940347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:36.940636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:36.941871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] PATH_INFO: `/v3/users/b65cf05be8e94a299c3c16eb5632f8a9` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:36.942496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b65cf05be8e94a299c3c16eb5632f8a9)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:36.945708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:36.966486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] MFA Rules not processed for user `5096cc9d086d4e778e0642f3f364e8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:36.967940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.012351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b65cf05be8e94a299c3c16eb5632f8a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.014880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b65cf05be8e94a299c3c16eb5632f8a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.026740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b65cf05be8e94a299c3c16eb5632f8a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.036327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b65cf05be8e94a299c3c16eb5632f8a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.037081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b65cf05be8e94a299c3c16eb5632f8a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.059401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 994/1947] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:37.059542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 954/1948] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:36 2022] DELETE /identity/v3/users/b65cf05be8e94a299c3c16eb5632f8a9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.059648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.061951 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.063668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.091494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.138423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cfccc-23c9-49b8-a6ac-574c2cf86800 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.168850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee87548-7b3e-49aa-a228-1238d8d02eba admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.175021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.176208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.176863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.177244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.178051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.182244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.204260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.224218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 955/1949] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:37 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:37.230038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.275921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.331144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c7866-3e20-47d5-9e02-dfac10c68d01 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.337132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.339320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.339797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.340173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.340950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.344253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.382084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 956/1950] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:37 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:37.388562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.395679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.396794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.397252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.398051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] PATH_INFO: `/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13/users/b6412867fbe343b0aa7ff4f7b2451ff2/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.422094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67f0b-5664-490e-8d18-42683de8afc3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.429295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.430327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.431724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.432131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.432923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.434684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.437888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa61c6779f1d4ef8b236c8357eb0ec13, user_id=b6412867fbe343b0aa7ff4f7b2451ff2, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.441316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.450369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 957/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:37.451128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.455615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.463904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 995/1952] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:37 2022] PUT /identity/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13/users/b6412867fbe343b0aa7ff4f7b2451ff2/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.465434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.481358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47c6f-1624-40b8-981e-baef679e1043 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.573838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08d2b-b5a7-4a89-b47a-7a25f1ec87fe admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.580267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.581275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.581919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.582521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] PATH_INFO: `/v3/projects/f5ffc417cdc54f08bd377e317e607a35/users/8de4caefe48948e9a04f2f6b8b138347/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.604013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ffc417cdc54f08bd377e317e607a35, user_id=8de4caefe48948e9a04f2f6b8b138347, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.609023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.629628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.632848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 996/1953] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:37 2022] PUT /identity/v3/projects/f5ffc417cdc54f08bd377e317e607a35/users/8de4caefe48948e9a04f2f6b8b138347/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.632848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.634220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.634805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.635426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] PATH_INFO: `/v3/projects/1de5998565a44bc085447a5518b4ad75` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.636903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de5998565a44bc085447a5518b4ad75)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.639350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.710884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de5998565a44bc085447a5518b4ad75', 'request_id': 'req-f0691d05-279a-454d-877d-f2c6b35b221a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.722016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de5998565a44bc085447a5518b4ad75', 'request_id': 'req-f0691d05-279a-454d-877d-f2c6b35b221a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.729011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f23-6b51-4a66-8204-e291f8135ff9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.732096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de5998565a44bc085447a5518b4ad75', 'request_id': 'req-f0691d05-279a-454d-877d-f2c6b35b221a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.748938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] The token cache is being invalidate because project 1de5998565a44bc085447a5518b4ad75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:37.749344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.750186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:37.752488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 958/1954] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:37 2022] DELETE /identity/v3/projects/1de5998565a44bc085447a5518b4ad75 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.753342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.754722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.769297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.804805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:37.845052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.845773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.846077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.846341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.846993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.848900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b617f33-7516-4566-99e0-503cd7ec9cee admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.850268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0691d05-279a-454d-877d-f2c6b35b221a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.857830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.858720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.859182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.859476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.860708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.861763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.872291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 997/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:37.873621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.873909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.874184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.878452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 959/1956] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:37.878452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.880823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.900913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:37.902455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:37.903719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29792d40-6766-41ff-b403-76f2c9d91f15 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.911722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 998/1957] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:37.911847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.912555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:37.912669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.913192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.913575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] PATH_INFO: `/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13/users/b6412867fbe343b0aa7ff4f7b2451ff2/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.918604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa61c6779f1d4ef8b236c8357eb0ec13, user_id=b6412867fbe343b0aa7ff4f7b2451ff2, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.922537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108433ad-e0ed-4603-a8d3-1a5a215f3254 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.925931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a1032-f4c8-44fd-b7c7-edcb5bc4d027 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:37.932904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:37.933844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.934222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.934763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] PATH_INFO: `/v3/projects/f5ffc417cdc54f08bd377e317e607a35/users/8de4caefe48948e9a04f2f6b8b138347/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.937102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ffc417cdc54f08bd377e317e607a35, user_id=8de4caefe48948e9a04f2f6b8b138347, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:37.940134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25f5cb-a75e-4fb4-8041-9d0c2c3fa554 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:37.941818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 960/1958] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:37 2022] PUT /identity/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13/users/b6412867fbe343b0aa7ff4f7b2451ff2/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.945205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14a70-91a3-4e68-8aa4-f8f9c5e47fc9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.946294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14a70-91a3-4e68-8aa4-f8f9c5e47fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.946733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d14a70-91a3-4e68-8aa4-f8f9c5e47fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.954750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 999/1959] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:37 2022] PUT /identity/v3/projects/f5ffc417cdc54f08bd377e317e607a35/users/8de4caefe48948e9a04f2f6b8b138347/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:37.958075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:37.960148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:37.960441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:37.979519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-32d14a70-91a3-4e68-8aa4-f8f9c5e47fc9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:37.980804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-32d14a70-91a3-4e68-8aa4-f8f9c5e47fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.008920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] MFA Rules not processed for user `b6412867fbe343b0aa7ff4f7b2451ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:38.010283 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.075294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 961/1960] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:38.075294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776905-0216-4257-98cf-30ab395c12da None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.075294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776905-0216-4257-98cf-30ab395c12da None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.075294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776905-0216-4257-98cf-30ab395c12da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.110560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1000/1961] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:38.115722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.115853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-21776905-0216-4257-98cf-30ab395c12da None None] MFA Rules not processed for user `8de4caefe48948e9a04f2f6b8b138347`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:38.115936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.116007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-21776905-0216-4257-98cf-30ab395c12da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.134743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643229-bbe4-4150-91e3-04d16df2a347 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.142833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.143518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.143792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.144065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] PATH_INFO: `/v3/users/4ffa9c4912c44509b45b5ed8080e15a5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.145742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ffa9c4912c44509b45b5ed8080e15a5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.148426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.197487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 962/1962] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:38.198952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776905-0216-4257-98cf-30ab395c12da None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.213927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776905-0216-4257-98cf-30ab395c12da None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.214261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ffa9c4912c44509b45b5ed8080e15a5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:38.215000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ffa9c4912c44509b45b5ed8080e15a5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:38.218667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.219415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.219698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.219966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.220816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:38.221219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.223297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.224901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ffa9c4912c44509b45b5ed8080e15a5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:38.225878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ffa9c4912c44509b45b5ed8080e15a5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:38.241509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 963/1963] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:38.241509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.244446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.245397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ffa9c4912c44509b45b5ed8080e15a5'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:38.268024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1001/1964] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:38 2022] DELETE /identity/v3/users/4ffa9c4912c44509b45b5ed8080e15a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:38.268982 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.270365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.286048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:38.292831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:38.344684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c77bd-c2f0-4eea-b38f-9b6d11f2379e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.368797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312273-a71c-43c1-ad7d-8f6203e163be admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.372948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.373862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.374196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.374474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.376374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.405100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.405824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.406339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.406712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.408797 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.453726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.455853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.469861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1002/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:38.472115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.473577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.504820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.508455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdbe3b-da0c-4138-86d4-d0461d62d0a2 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.526887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 964/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:38.530075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.536380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.537112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.561465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:38.562018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af44d20-ddb6-4935-93fb-7384310ae24b service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.562674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.569258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.570269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.571707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.572176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.572633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 965/1967] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:38.572996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.575219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.584341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.585958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:38.644026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1003/1968] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:38 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:38.644026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.698502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f03500-2a89-4ef8-957b-ed7b190650c2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.728403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:38.755608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b6264-e98a-40d5-b827-22ddead90211 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.763337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.764030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.764313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.764589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.765229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.769562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:38.771029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.785066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.786037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.786460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.786899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.801472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.803087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.803456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1004/1969] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:38 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:38.808866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.824027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 966/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:38.835723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19470f-fdf3-4ab6-aba5-e0301febf8bf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.843368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.843985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.844269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.844543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.845337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.846998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.862799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1005/1971] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:38.868546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.879120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa376d69-d11e-4771-9c41-a32948b49286 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.884976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.885615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.885897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.886176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.887030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.888713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625c5e8-4379-42eb-b052-f03ad8bb713f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.907342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 967/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:38.907514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:38.920742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c1242-99f7-4f89-96d4-8aeb22df048d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:38.934149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:38.935472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.935799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.936157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] PATH_INFO: `/v3/projects/46f4f00ec80747a68dd0849167cc3754/users/1bdda840c84c45529ff4e85dc734c772/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:38.957340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f4f00ec80747a68dd0849167cc3754, user_id=1bdda840c84c45529ff4e85dc734c772, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:38.960827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:38.991247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1006/1973] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:38 2022] PUT /identity/v3/projects/46f4f00ec80747a68dd0849167cc3754/users/1bdda840c84c45529ff4e85dc734c772/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:38.997359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:38.997850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:38.998065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.067626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] MFA Rules not processed for user `1bdda840c84c45529ff4e85dc734c772`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:39.069538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.167820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.221578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 968/1974] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:39.225800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.274966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fbabb-670a-4e0b-8c76-2e19dd70de2d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.281917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6412867fbe343b0aa7ff4f7b2451ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.282930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.283430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.283887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.285047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:39.285558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.287920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.309743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1007/1975] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:39.314400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.329623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf57d2-4c45-4a48-80b1-ee16c2e35b40 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.339702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf130d-17fd-473a-8535-3709864a27bf None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.340450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6412867fbe343b0aa7ff4f7b2451ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.341314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.341817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.342748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.343493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.345560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.346252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.347131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.347642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.348116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.348960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.352995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.388076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1008/1976] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:39 2022] POST /identity/v3/projects => generated 354 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:39.390452 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.401748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 969/1977] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:39 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:39.406385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.408279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.495182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024baa33-aa98-4602-b2ff-6ccc9d230d2c tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.497592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:39.509835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:39.514994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e012b-f941-47ba-858c-b67dd3d10a5b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.521569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.522630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.523011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.523427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] PATH_INFO: `/v3/projects/e70bc9e116ec4c76acb9d350b80e8a1d` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.525898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70bc9e116ec4c76acb9d350b80e8a1d)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.529128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.570155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6412867fbe343b0aa7ff4f7b2451ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.570155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.570155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.571037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.571829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:39.572237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.574069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.585582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70bc9e116ec4c76acb9d350b80e8a1d', 'request_id': 'req-db424178-7d9d-4a98-b887-938ca647daa7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.587942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1009/1978] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:39.588540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.598735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70bc9e116ec4c76acb9d350b80e8a1d', 'request_id': 'req-db424178-7d9d-4a98-b887-938ca647daa7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.605451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0732fd-c333-4ddf-becb-2641a4ad482b tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.606098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70bc9e116ec4c76acb9d350b80e8a1d', 'request_id': 'req-db424178-7d9d-4a98-b887-938ca647daa7'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.619567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] The token cache is being invalidate because project e70bc9e116ec4c76acb9d350b80e8a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:39.620590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.621502 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.625840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 970/1979] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:39 2022] DELETE /identity/v3/projects/e70bc9e116ec4c76acb9d350b80e8a1d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:39.630484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.631972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.720508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.721248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.721530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.721878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.722632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.724678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.729181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db424178-7d9d-4a98-b887-938ca647daa7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.734353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.735869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.736162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.736436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] PATH_INFO: `/v3/users/9cd9cbee2b7b4287b2647d473a57af0d` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.738060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd9cbee2b7b4287b2647d473a57af0d)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.742333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.769114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1010/1980] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:39 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:39.769947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.773578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.846440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd9cbee2b7b4287b2647d473a57af0d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.848181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd9cbee2b7b4287b2647d473a57af0d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.866259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd9cbee2b7b4287b2647d473a57af0d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.876895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd9cbee2b7b4287b2647d473a57af0d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.877888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd9cbee2b7b4287b2647d473a57af0d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.885772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1c732-f620-4d5d-abef-17884874be8f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:39.893011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6412867fbe343b0aa7ff4f7b2451ff2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:39.893767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:39.894191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:39.895574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] PATH_INFO: `/v3/projects/61929f9a3c2a401fb0229fcd39709c24` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:39.897583 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorizing `identity:delete_project(project_id=61929f9a3c2a401fb0229fcd39709c24)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:39.899247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:39.903062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:39.931361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 971/1981] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:39 2022] DELETE /identity/v3/users/9cd9cbee2b7b4287b2647d473a57af0d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:39.934250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:39.947961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:39.965717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:39.976113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61929f9a3c2a401fb0229fcd39709c24', 'request_id': 'req-ff728929-12fd-44a1-ad04-10e9105570f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.984758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61929f9a3c2a401fb0229fcd39709c24', 'request_id': 'req-ff728929-12fd-44a1-ad04-10e9105570f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:39.996190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61929f9a3c2a401fb0229fcd39709c24', 'request_id': 'req-ff728929-12fd-44a1-ad04-10e9105570f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.019537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] The token cache is being invalidate because project 61929f9a3c2a401fb0229fcd39709c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:40.019904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.020786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.023978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1011/1982] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:39 2022] DELETE /identity/v3/projects/61929f9a3c2a401fb0229fcd39709c24 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:40.060953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba314915-38a7-4b0b-b561-283f59f5e616 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.160886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.161868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.162262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.162643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.164979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.168005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.196386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 972/1983] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:40.198820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.200766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.232681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728929-12fd-44a1-ad04-10e9105570f8 tempest-VolumeQuotaClassesTest-2084079808 tempest-VolumeQuotaClassesTest-2084079808-project-admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.247281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.248178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.248647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.248996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] PATH_INFO: `/v3/projects/5cb3864eba7740589b10c8469e82b3f1/users/6ef5543895fa47718dc95b5ab63204d4/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.280129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb3864eba7740589b10c8469e82b3f1, user_id=6ef5543895fa47718dc95b5ab63204d4, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.283779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.318877 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1012/1984] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:40 2022] PUT /identity/v3/projects/5cb3864eba7740589b10c8469e82b3f1/users/6ef5543895fa47718dc95b5ab63204d4/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:40.324646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.344042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.344336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf42f0-401c-4616-b49a-0cddd6ab6918 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.345916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.502918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f375-698f-489c-9c8f-f0135028cf29 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.509229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.509974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.510488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.511116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] PATH_INFO: `/v3/users/3ad610f7f4d54d258f0311b781afcab4` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.512507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad610f7f4d54d258f0311b781afcab4)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.513800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.514448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.514810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.514914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.514989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.520084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.524481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.550413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 973/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:40.551260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.556708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.592892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97547d78-f5a4-4e6a-8c71-7b40d958d7f3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.614076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad610f7f4d54d258f0311b781afcab4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.615072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad610f7f4d54d258f0311b781afcab4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.627066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad610f7f4d54d258f0311b781afcab4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.628012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad610f7f4d54d258f0311b781afcab4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.628149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.628897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.629253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.629629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] PATH_INFO: `/v3/projects/644800ab4f7645fb95aad535e7e0babe` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.630977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=644800ab4f7645fb95aad535e7e0babe)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.633915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.638913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad610f7f4d54d258f0311b781afcab4'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.670844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1013/1986] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:40 2022] DELETE /identity/v3/users/3ad610f7f4d54d258f0311b781afcab4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:40.674475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:40.680934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.698894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.724290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:40.726778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644800ab4f7645fb95aad535e7e0babe', 'request_id': 'req-a4a15651-d24d-4c52-ab77-c9af196d4f42'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.752001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644800ab4f7645fb95aad535e7e0babe', 'request_id': 'req-a4a15651-d24d-4c52-ab77-c9af196d4f42'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.764230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644800ab4f7645fb95aad535e7e0babe', 'request_id': 'req-a4a15651-d24d-4c52-ab77-c9af196d4f42'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.780282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] The token cache is being invalidate because project 644800ab4f7645fb95aad535e7e0babe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:40.781121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.782184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a4a15651-d24d-4c52-ab77-c9af196d4f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:40.787689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc18b-a93b-4d22-bbf0-73ea24ffc564 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:40.787847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 974/1987] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:40 2022] DELETE /identity/v3/projects/644800ab4f7645fb95aad535e7e0babe => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:40.790094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db393-6a1c-4759-abde-95c3135a41ed None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.790880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db393-6a1c-4759-abde-95c3135a41ed None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.791196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db393-6a1c-4759-abde-95c3135a41ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.826259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2e6db393-6a1c-4759-abde-95c3135a41ed None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:40.827979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2e6db393-6a1c-4759-abde-95c3135a41ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.886061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:40.887247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.887348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.887566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] PATH_INFO: `/v3/projects/5cb3864eba7740589b10c8469e82b3f1/users/6ef5543895fa47718dc95b5ab63204d4/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.889762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb3864eba7740589b10c8469e82b3f1, user_id=6ef5543895fa47718dc95b5ab63204d4, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:40.892858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12bd1c-5bc0-44ac-8645-d6fbef1c6ebf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:40.906695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1014/1988] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:40 2022] PUT /identity/v3/projects/5cb3864eba7740589b10c8469e82b3f1/users/6ef5543895fa47718dc95b5ab63204d4/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:40.908369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.908658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.908929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:40.947675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:40.948919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:40.986930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 975/1989] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:40.990447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aebc4-9c2a-47aa-bb11-a692ab9d9e66 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:40.991143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aebc4-9c2a-47aa-bb11-a692ab9d9e66 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:40.991474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1aebc4-9c2a-47aa-bb11-a692ab9d9e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.071936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1015/1990] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:41.073048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.080204 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.108284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1f1aebc4-9c2a-47aa-bb11-a692ab9d9e66 None None] MFA Rules not processed for user `6ef5543895fa47718dc95b5ab63204d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:41.109973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1f1aebc4-9c2a-47aa-bb11-a692ab9d9e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.214740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577922-9b23-4ed0-877b-ab2b317ef89e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.226466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.229128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.230613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.230965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.253135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.256542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.286145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 976/1991] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:41.287867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.288035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.288309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.294441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1016/1992] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:41.296258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.298604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.311978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:41.325744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:41.328982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.343869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 977/1993] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:41.348933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.365352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d588d-ee59-4c8a-b32e-485cae82a882 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.371141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.371886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.372246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.372648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.374291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:41.374688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.376789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.403212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 978/1994] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:41.405083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e20db-4199-49d8-8595-54cc99eec92c service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.408053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.417707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.418355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.418639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.418912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.447355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.449010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.465092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075442-604f-436c-994b-fbf9f2c35e42 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.469512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1017/1995] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:41.496590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.499614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.500089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.500399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.501076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.510772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.548443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.550095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.577898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007864a-1901-44c7-a739-6d70d1ab3d5a service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.585951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.587540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.587906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.588168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] PATH_INFO: `/v3/users/5096cc9d086d4e778e0642f3f364e8d1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.591835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5096cc9d086d4e778e0642f3f364e8d1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.597371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.605408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 979/1996] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:41 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:41.606671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.616253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:41.741615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5096cc9d086d4e778e0642f3f364e8d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:41.742650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5096cc9d086d4e778e0642f3f364e8d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:41.760908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5096cc9d086d4e778e0642f3f364e8d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:41.761981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5096cc9d086d4e778e0642f3f364e8d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:41.784886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-26e542de-dc10-4a8f-8f66-c8e9b440e1eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5096cc9d086d4e778e0642f3f364e8d1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:41.798741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be56a6c-e485-4650-8a4b-98763cad4ff8 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.816015 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.817080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.817362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.817637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.818283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.824944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.829520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1018/1997] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:41 2022] DELETE /identity/v3/users/5096cc9d086d4e778e0642f3f364e8d1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:41.833661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.833957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.834240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.873693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 980/1998] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:41 2022] POST /identity/v3/users => generated 292 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:41.874805 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.876830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:41.878080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.880905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:41.898109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f7ceb1-28a8-456a-9aaa-d5744384a6c2 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:41.969839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:41.971075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:41.971444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:41.971726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] PATH_INFO: `/v3/users/1bdda840c84c45529ff4e85dc734c772` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:41.972952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdda840c84c45529ff4e85dc734c772)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:41.975606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:41.983309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1019/1999] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:41.984430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:41.986041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.004076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb125ff6-3472-4447-9212-4c90e385992b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.017703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.018454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.018787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.019069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.020035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.022082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.051886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1020/2000] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:42.056545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.070981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdda840c84c45529ff4e85dc734c772'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:42.072393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdda840c84c45529ff4e85dc734c772'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:42.077827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c202-6ce7-4bdf-8c3d-dcc8ee1f7572 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.082682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdda840c84c45529ff4e85dc734c772'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:42.085082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.085722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.086623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.087022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.088035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.090022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.095228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdda840c84c45529ff4e85dc734c772'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:42.096208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0caf5737-5f62-4cfd-a6fb-61708187a99f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdda840c84c45529ff4e85dc734c772'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:42.104732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1021/2001] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:42.108608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.110539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.125635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.130946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651f4d3-b4ed-4dc5-9002-188fea7e1b2c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.142907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 981/2002] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:41 2022] DELETE /identity/v3/users/1bdda840c84c45529ff4e85dc734c772 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:42.150394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.150657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd22b-1110-4293-a567-456562d702f0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.150792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd22b-1110-4293-a567-456562d702f0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.151058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd22b-1110-4293-a567-456562d702f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.152791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.153068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.153336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] PATH_INFO: `/v3/projects/4c331a66bfd441ffa74793661d2864af/users/393aa8916e86447f9cf6e59474a934ae/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.176100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c331a66bfd441ffa74793661d2864af, user_id=393aa8916e86447f9cf6e59474a934ae, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.179184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.183339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-05cdd22b-1110-4293-a567-456562d702f0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:42.185427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-05cdd22b-1110-4293-a567-456562d702f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.198508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.200694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1022/2003] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:42 2022] PUT /identity/v3/projects/4c331a66bfd441ffa74793661d2864af/users/393aa8916e86447f9cf6e59474a934ae/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:42.214714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.219831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.294678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 982/2004] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:42.296260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.296555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.296835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.339767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] MFA Rules not processed for user `393aa8916e86447f9cf6e59474a934ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:42.342625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.359393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36ca70-2964-41af-85e7-a95dd5c21e88 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.359393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.359393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.359393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.359758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.365737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.459284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.461138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.469056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 983/2005] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:42.470621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.472373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:42.475761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1023/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:42.476520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.490095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbbde2-2ea7-41b0-85ab-af85556791de service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.490690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21c0e9-a6f3-40fc-9b10-6673f823ddd2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.497752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.498944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.499277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.499556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.500318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.502777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.502949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.503978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.504555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.505034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.519672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.521960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.538571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 984/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:42.543209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1024/2008] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:42 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:42.546531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.559102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355be943-9642-473b-b99f-2b6abcb6b9b8 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.658227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.659888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.660632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.661209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.661860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.665390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.706353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.706784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 985/2009] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:42 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:42.724328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f158a8-8cc3-4a42-8e67-ff07c4a2776c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.737275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.738005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.738359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.738736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.739619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.741456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.762359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1025/2010] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:42.766489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.780659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccac0-406b-4b87-994c-7752ab7195d1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.787750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.788491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.788786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.789071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] PATH_INFO: `/v3/projects/119caba3e6fa45c3aade7f1c005fd788/users/5f631e15e4574db8bb9872c157ba6f48/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.813336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=119caba3e6fa45c3aade7f1c005fd788, user_id=5f631e15e4574db8bb9872c157ba6f48, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.817007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:42.822925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.859396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 986/2011] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:42 2022] PUT /identity/v3/projects/119caba3e6fa45c3aade7f1c005fd788/users/5f631e15e4574db8bb9872c157ba6f48/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:42.863768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:42.876024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dbc7d-dd1c-4059-89be-3551bba987cd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:42.971715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:42.990490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:42.992012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:42.993208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:42.993892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:42.994800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:42.996930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b1e6a-3d38-4d68-ad9e-3fec2712861f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.012419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1026/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:43.017084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.037480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fac028-5658-4809-9b6c-f3c02dd15faa admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:43.047469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:43.048565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.049334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.049837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] PATH_INFO: `/v3/projects/119caba3e6fa45c3aade7f1c005fd788/users/5f631e15e4574db8bb9872c157ba6f48/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.053996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=119caba3e6fa45c3aade7f1c005fd788, user_id=5f631e15e4574db8bb9872c157ba6f48, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:43.061234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.096557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 987/2013] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:43 2022] PUT /identity/v3/projects/119caba3e6fa45c3aade7f1c005fd788/users/5f631e15e4574db8bb9872c157ba6f48/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:43.097019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.097579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.097870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.135807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] MFA Rules not processed for user `5f631e15e4574db8bb9872c157ba6f48`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:43.137058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.215096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.217141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.250505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1027/2014] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:43.262940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.265200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.402211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32946b6-150d-48e4-a445-83f7c071c10b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:43.407890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:43.408646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.409469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.410004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] PATH_INFO: `/v3/projects/46f4f00ec80747a68dd0849167cc3754` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.410290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1926a-8d14-4a4b-bd0c-c1d8a90b1898 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:43.411755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f4f00ec80747a68dd0849167cc3754)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:43.414848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.415542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:43.416215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.416496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.416769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.505325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f4f00ec80747a68dd0849167cc3754', 'request_id': 'req-0f520459-7bbb-4dae-b765-9478742a8957'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.509592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:43.514060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.526412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f4f00ec80747a68dd0849167cc3754', 'request_id': 'req-0f520459-7bbb-4dae-b765-9478742a8957'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.535668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f4f00ec80747a68dd0849167cc3754', 'request_id': 'req-0f520459-7bbb-4dae-b765-9478742a8957'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.546280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1028/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:43.549508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.552348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.561370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] The token cache is being invalidate because project 46f4f00ec80747a68dd0849167cc3754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:43.561670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.566101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.573863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 988/2016] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:43 2022] DELETE /identity/v3/projects/46f4f00ec80747a68dd0849167cc3754 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:43.575228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.578181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.582504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adff6d-f572-4522-951f-b76e0cdc3c6e service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:43.657015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:43.774984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:43.776898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.777083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.779740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] PATH_INFO: `/v3/projects/0ed321a0789943fa8013b7d8c0901fe6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.781087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ed321a0789943fa8013b7d8c0901fe6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:43.784555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.791465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f520459-7bbb-4dae-b765-9478742a8957 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:43.803226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:43.803878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:43.804156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:43.804425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] PATH_INFO: `/v3/users/6ef5543895fa47718dc95b5ab63204d4` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:43.807823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef5543895fa47718dc95b5ab63204d4)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:43.809915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:43.838148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:43.895675 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ed321a0789943fa8013b7d8c0901fe6', 'request_id': 'req-65aff7ed-937a-4cee-8b40-284997f6f20b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.906062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ed321a0789943fa8013b7d8c0901fe6', 'request_id': 'req-65aff7ed-937a-4cee-8b40-284997f6f20b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.908009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef5543895fa47718dc95b5ab63204d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.909143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef5543895fa47718dc95b5ab63204d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.920961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ed321a0789943fa8013b7d8c0901fe6', 'request_id': 'req-65aff7ed-937a-4cee-8b40-284997f6f20b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.925596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef5543895fa47718dc95b5ab63204d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.939475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] The token cache is being invalidate because project 0ed321a0789943fa8013b7d8c0901fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:43.939847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.940971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.943282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1029/2017] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:43 2022] DELETE /identity/v3/projects/0ed321a0789943fa8013b7d8c0901fe6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:43.946323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.946482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:43.947280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef5543895fa47718dc95b5ab63204d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.950876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef5543895fa47718dc95b5ab63204d4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:43.996470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 989/2018] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:43 2022] DELETE /identity/v3/users/6ef5543895fa47718dc95b5ab63204d4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:43.997675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:43.999092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:44.069893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aff7ed-937a-4cee-8b40-284997f6f20b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:44.090903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b311a-e539-4eea-ad5a-74ffa5306daf admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:44.098461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:44.100391 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:44.100969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:44.101435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] PATH_INFO: `/v3/users/8de4caefe48948e9a04f2f6b8b138347` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:44.103213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de4caefe48948e9a04f2f6b8b138347)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:44.105759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:44.215436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:44.217175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:44.217924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:44.218253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de4caefe48948e9a04f2f6b8b138347'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.218518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] PATH_INFO: `/v3/projects/fa7780bd7ed14021a3bec2b4a776d258` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:44.219443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de4caefe48948e9a04f2f6b8b138347'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.220289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7780bd7ed14021a3bec2b4a776d258)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:44.225433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:44.244224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de4caefe48948e9a04f2f6b8b138347'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.249653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:44.271969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de4caefe48948e9a04f2f6b8b138347'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.277621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de4caefe48948e9a04f2f6b8b138347'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.328324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 990/2019] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:43 2022] DELETE /identity/v3/users/8de4caefe48948e9a04f2f6b8b138347 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:44.361265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7780bd7ed14021a3bec2b4a776d258', 'request_id': 'req-402877e2-6e28-492b-931e-07c569148277'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.379149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7780bd7ed14021a3bec2b4a776d258', 'request_id': 'req-402877e2-6e28-492b-931e-07c569148277'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.394286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7780bd7ed14021a3bec2b4a776d258', 'request_id': 'req-402877e2-6e28-492b-931e-07c569148277'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.417948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] The token cache is being invalidate because project fa7780bd7ed14021a3bec2b4a776d258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:44.418288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.419349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.421736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1030/2020] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:43 2022] DELETE /identity/v3/projects/fa7780bd7ed14021a3bec2b4a776d258 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:44.425467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:44.427784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:44.450924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:44.541954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa286f-80f4-4d20-944c-53598d78d777 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:44.548319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:44.549245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:44.549632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:44.550621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] PATH_INFO: `/v3/users/b6412867fbe343b0aa7ff4f7b2451ff2` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:44.552046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6412867fbe343b0aa7ff4f7b2451ff2)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:44.554240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:44.642762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6412867fbe343b0aa7ff4f7b2451ff2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.643784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6412867fbe343b0aa7ff4f7b2451ff2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.654850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6412867fbe343b0aa7ff4f7b2451ff2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.685513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6412867fbe343b0aa7ff4f7b2451ff2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.688394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6412867fbe343b0aa7ff4f7b2451ff2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.707490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:44.708944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:44.746163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 991/2021] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:44 2022] DELETE /identity/v3/users/b6412867fbe343b0aa7ff4f7b2451ff2 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:44.777710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:44.779178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:44.821820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402877e2-6e28-492b-931e-07c569148277 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:44.911686 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:44.912454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:44.912718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:44.913045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] PATH_INFO: `/v3/projects/5cb3864eba7740589b10c8469e82b3f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:44.914972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb3864eba7740589b10c8469e82b3f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:44.917518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:44.922238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6d658-ada8-47f3-8e6b-dc316c7ec356 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:44.930612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:44.932096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:44.932487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:44.933535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] PATH_INFO: `/v3/projects/f5ffc417cdc54f08bd377e317e607a35` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:44.935311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ffc417cdc54f08bd377e317e607a35)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:44.937837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:44.981988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:44.984439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb3864eba7740589b10c8469e82b3f1', 'request_id': 'req-97418250-1b9c-4d31-bf81-a329a2c2551f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:44.999493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.008387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb3864eba7740589b10c8469e82b3f1', 'request_id': 'req-97418250-1b9c-4d31-bf81-a329a2c2551f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.018911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ffc417cdc54f08bd377e317e607a35', 'request_id': 'req-98409b79-094d-4eb0-a7aa-5986b0c2ac07'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.024404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb3864eba7740589b10c8469e82b3f1', 'request_id': 'req-97418250-1b9c-4d31-bf81-a329a2c2551f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.029444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ffc417cdc54f08bd377e317e607a35', 'request_id': 'req-98409b79-094d-4eb0-a7aa-5986b0c2ac07'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.038334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ffc417cdc54f08bd377e317e607a35', 'request_id': 'req-98409b79-094d-4eb0-a7aa-5986b0c2ac07'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.040833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] The token cache is being invalidate because project 5cb3864eba7740589b10c8469e82b3f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:45.041146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.041831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-97418250-1b9c-4d31-bf81-a329a2c2551f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.043815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1031/2022] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:44 2022] DELETE /identity/v3/projects/5cb3864eba7740589b10c8469e82b3f1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:45.048956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d839c-1c94-464d-93c2-4ba5ffef7413 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.049245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d839c-1c94-464d-93c2-4ba5ffef7413 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.049524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d839c-1c94-464d-93c2-4ba5ffef7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.057858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] The token cache is being invalidate because project f5ffc417cdc54f08bd377e317e607a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:45.058552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.059689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-98409b79-094d-4eb0-a7aa-5986b0c2ac07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.066779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 992/2023] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:44 2022] DELETE /identity/v3/projects/f5ffc417cdc54f08bd377e317e607a35 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:45.068721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae3df-23b6-4333-9515-fb059d641e22 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.069595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae3df-23b6-4333-9515-fb059d641e22 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.069902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae3df-23b6-4333-9515-fb059d641e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.075492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6e5d839c-1c94-464d-93c2-4ba5ffef7413 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:45.076806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6e5d839c-1c94-464d-93c2-4ba5ffef7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.100691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6d6ae3df-23b6-4333-9515-fb059d641e22 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:45.102606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6d6ae3df-23b6-4333-9515-fb059d641e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.172116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1032/2024] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:45.182071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.182477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.183047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.198395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 993/2025] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:45.216059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.216350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.216637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.235435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:45.240762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.268740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1033/2026] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:45.272940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.292511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:45.293088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.306418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 994/2027] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:45.307888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2865-e9b0-4c37-b2a2-e50bb55c5e56 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.310374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.324934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.326640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.327327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.328006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.328808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:45.329401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.331386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.337243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80011106-25a4-4f9d-b990-318868fc9e08 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.352064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.352873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.353526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.353906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.355376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:45.356059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.361108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.363676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1034/2028] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:45.368104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.388850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374a66-7957-4fcd-a5d4-47004df02ad7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.403590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 995/2029] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:45.409335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.409856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.409987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.410536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.410536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.411130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.413092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.432037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7779-f265-4dd5-9129-b41f500378ee admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.443571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.444490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.446397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.447287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.447954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.452721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.477943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1035/2030] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:45.479658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.484965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:45.538977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 996/2031] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:45.540786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.636999 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d7b80-8a86-488e-a043-e7ee2040adfd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.678001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e5cef-f397-45c0-9412-dc014985c187 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.684435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.685102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.685381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.685746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.686635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.688622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.741815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.749405 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 997/2032] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:45.750708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.766432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92bc1d-6f43-46e0-bcf0-0d25c5c002b3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.779704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.781104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.782034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:45.782378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.783017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:45.783454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] PATH_INFO: `/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.784281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:45.785221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa61c6779f1d4ef8b236c8357eb0ec13)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.785602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:45.786338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:45.788405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.790496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:45.817817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:45.847239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 998/2033] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:45 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:45.848150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.879435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cace7ce-bf43-4368-87da-60f131870de2 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:45.898383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'request_id': 'req-a29320de-904a-44df-a5ca-244abf35f5bc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.920082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'request_id': 'req-a29320de-904a-44df-a5ca-244abf35f5bc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.937854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa61c6779f1d4ef8b236c8357eb0ec13', 'request_id': 'req-a29320de-904a-44df-a5ca-244abf35f5bc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.953881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] The token cache is being invalidate because project fa61c6779f1d4ef8b236c8357eb0ec13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:45.954412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.955485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:45.962366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1036/2034] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:45 2022] DELETE /identity/v3/projects/fa61c6779f1d4ef8b236c8357eb0ec13 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:45.963529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:45.965714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.087356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.087988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.088277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.088550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.089195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.090820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c19610-b6e0-4dd8-b1c7-0f8e0e3793dc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.100252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29320de-904a-44df-a5ca-244abf35f5bc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.102658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 999/2035] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.104103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.104381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.104656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.106962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.107834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.108196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.108475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.109140 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.111021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.125284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1037/2036] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.126405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.128453 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.131764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:46.133199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.146154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bda6-355c-4e51-be2d-ac1f2b735c83 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.151522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1000/2037] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:46.152523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.153723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.155601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.159080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.159308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.159988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.161644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b81ba-f661-4cbc-be30-da6b58ae83b1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.162702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d079-ec0b-48e9-8469-ebcc74b26feb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.168203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.168827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.169588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.169588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.170076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.171736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.186940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1038/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.187099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1001/2039] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.187202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.187202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.187202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.188574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.200520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf564dc-fd2c-46ce-a878-1ba24df3fb41 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.209989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:46.213787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.216145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.216939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.217288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.217645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] PATH_INFO: `/v3/projects/b81b36997cee44a88bddbfbfc71d50d9/users/b9c49252a9e04b7fa6608674de7f86ae/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.230223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1039/2040] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:46.230223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.239933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069e25b-8406-4239-bf78-0e527ee8c095 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.240265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81b36997cee44a88bddbfbfc71d50d9, user_id=b9c49252a9e04b7fa6608674de7f86ae, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.244252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.245857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.246630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.246983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.247783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] PATH_INFO: `/v3/projects/b501c2a0bcd54d779f309e1456e8dde5/users/fe7b103f327041b3916e8c8a427496a8/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.260980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1002/2041] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:46 2022] PUT /identity/v3/projects/b81b36997cee44a88bddbfbfc71d50d9/users/b9c49252a9e04b7fa6608674de7f86ae/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:46.261942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.268018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b501c2a0bcd54d779f309e1456e8dde5, user_id=fe7b103f327041b3916e8c8a427496a8, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.270546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22826bf-a732-47eb-a4d2-c25c89bc98a8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.286804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1040/2042] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:46 2022] PUT /identity/v3/projects/b501c2a0bcd54d779f309e1456e8dde5/users/fe7b103f327041b3916e8c8a427496a8/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:46.288404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50026-6b6e-4675-8d03-f7fbbebc80ad None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.288845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50026-6b6e-4675-8d03-f7fbbebc80ad None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.289929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee50026-6b6e-4675-8d03-f7fbbebc80ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.326067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8ee50026-6b6e-4675-8d03-f7fbbebc80ad None None] MFA Rules not processed for user `b9c49252a9e04b7fa6608674de7f86ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:46.327293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8ee50026-6b6e-4675-8d03-f7fbbebc80ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.344037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.372517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285bc7-5318-4ee2-a108-0326c5ad21f0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.408200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1041/2043] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:46.409466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.409760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.410036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.440422 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.446219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] MFA Rules not processed for user `fe7b103f327041b3916e8c8a427496a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:46.448990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:46.453353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.453979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.454260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.454533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.455192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:46.455500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.457132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.470317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1003/2044] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:46.471182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.482283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b79a0-9bec-44ac-8ddd-703940a4a00e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.487050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.487690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.487972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.488240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.488869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.490779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.530170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1004/2045] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.531352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.541389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1042/2046] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:46.542231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.558806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2993c-93bb-43fe-9bae-a0642e192a57 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.622476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30175559-65a9-438f-8895-f3cc5e5b54a7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.628033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.628670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.629130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.629243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.629851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.632490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.639986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.640601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.640881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.641205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.641841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.644292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.669673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1005/2047] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.670617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.673397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1043/2048] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.674425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.688037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a41026-882d-45ab-95cf-b0ec32e7988f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.736898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.774776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.776089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.776503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.776783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.777573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.778042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b64d-4d23-4907-b2ec-c01a0167ee10 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.779680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.783288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.783968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.784189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.784618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.785264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.787207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.817210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1044/2049] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.817210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.831321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1006/2050] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.831473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc171d-9f96-4c9a-97e0-28c77d75bbeb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.831593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.890470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:46.907530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.908155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.908441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.908717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.909362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.911136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.920723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23528315-8b7f-4a77-a091-f973611efbc2 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.925272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1045/2051] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.925272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.932020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.933057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.933702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.934237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.935474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.935597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbce81-2e21-4b59-9cd9-1d9b32d6e2c5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.937844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.942347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.943333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.943661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.944559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.945214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.947818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.949316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1007/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.952982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.964636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c601b-b7b9-4235-aebb-1fc24f8c0ae7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.970273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.971039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.971360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.971633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.972285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:46.974224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:46.978168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1046/2053] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:46 2022] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:46.978168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.988123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8dc828-b6e4-46bd-97e0-534cfe5a92e3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:46.995684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1008/2054] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:46.995684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:46.996267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:46.996990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:46.997267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:46.997562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:46.998428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.000199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.013613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1047/2055] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:47.014596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.025631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444c5f-64f8-4747-8cf8-36e5c2155455 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.030647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d438-14c3-485c-8334-0aba98c74864 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.032175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.033184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.033671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.034107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.035113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.036823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.037541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.038519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.039038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.040143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] PATH_INFO: `/v3/projects/fefefeb7807246c1a9d4a0dfef678b83/users/5b25d127c31b458c95befdda231fbb35/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.052193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1009/2056] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:47.056654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.062855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fefefeb7807246c1a9d4a0dfef678b83, user_id=5b25d127c31b458c95befdda231fbb35, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.067323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.069637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a5f98-facf-4bd9-8c50-973000b5f758 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.077978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.079344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.079727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.080064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] PATH_INFO: `/v3/projects/4707086a284248acae5ba7480f7959c7/users/879ed41ae6ea43b2b9b1e0893ce239f1/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.093717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1048/2057] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:47 2022] PUT /identity/v3/projects/fefefeb7807246c1a9d4a0dfef678b83/users/5b25d127c31b458c95befdda231fbb35/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:47.094600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.110448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4707086a284248acae5ba7480f7959c7, user_id=879ed41ae6ea43b2b9b1e0893ce239f1, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.115881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae6781-24b4-40ee-8d76-64417d51778c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.143377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1010/2058] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:47 2022] PUT /identity/v3/projects/4707086a284248acae5ba7480f7959c7/users/879ed41ae6ea43b2b9b1e0893ce239f1/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:47.143377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.143377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.143377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.184976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] MFA Rules not processed for user `5b25d127c31b458c95befdda231fbb35`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:47.186392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:47.190252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437891b2-ea99-43fe-919c-ea5bbf7f4316 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.210996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.282282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.282282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.282282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.282282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.282728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.282728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316782f9-c7a5-474b-85ef-46643e88ec48 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.292091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1049/2059] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:47.293395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b112c-7cdf-43b5-b8d6-cdb9eebfd3dc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.293687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b112c-7cdf-43b5-b8d6-cdb9eebfd3dc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.293966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b112c-7cdf-43b5-b8d6-cdb9eebfd3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.303321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1011/2060] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:47.306445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.325624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aad8e-2423-4cd7-8062-ff87980f2c10 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.331035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.332400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.339125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-263b112c-7cdf-43b5-b8d6-cdb9eebfd3dc None None] MFA Rules not processed for user `879ed41ae6ea43b2b9b1e0893ce239f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:47.340781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-263b112c-7cdf-43b5-b8d6-cdb9eebfd3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:47.347392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.347683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] PATH_INFO: `/v3/projects/b50a7257cf5949f485d6a27c3a07b898/users/53bcf34d4efc4db79830040335393d7c/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.365734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50a7257cf5949f485d6a27c3a07b898, user_id=53bcf34d4efc4db79830040335393d7c, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.369501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.385381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1012/2061] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:47 2022] PUT /identity/v3/projects/b50a7257cf5949f485d6a27c3a07b898/users/53bcf34d4efc4db79830040335393d7c/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:47.392086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.421245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1050/2062] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:47.422421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.422770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.423107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.454475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.457889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] MFA Rules not processed for user `53bcf34d4efc4db79830040335393d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:47.459527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:47.470731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de9e8b-0854-4bff-8592-650f0ec231f1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.478017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.478875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.479298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.479903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.480833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.483816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.514386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1013/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:47.516039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.545310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1051/2064] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:47.546077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.569053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e34a58-427c-4fa7-9a8a-4c6cc9376b47 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.605576 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.618818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda587e0-93f1-4c33-959d-d5938a082566 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.625082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.625698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.625979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.626296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.626909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.628891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.636118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.636819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.637106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.637380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.638006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.640007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.660965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1014/2065] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:47.662196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.662696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1052/2066] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/users => generated 296 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:47.666248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.676543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6b6fd-c960-4f6f-af55-30a6cdc0ec52 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.729880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e8737-18c0-4fb3-8ce9-fd33a7d33474 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.734962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.735605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.735912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.736186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.736820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.737408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.738022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.738300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.738574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.738730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.739251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.741190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.766031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1053/2067] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:15:47.766879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.774838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1015/2068] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:47.774838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.780249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbb467-1f68-4466-aafe-12cb1b352635 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.840207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:47.851072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.852254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.852254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.852700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.853508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.855638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.860147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f811bf-688a-4e13-a752-f0f4c50b177d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.867284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.868300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.871760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1054/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:47.871888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.871888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.872045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.872130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.872130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.881978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3d4da-5a1a-4095-9265-d19ba297b973 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.882588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1016/2070] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:47.884338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.892732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.893402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.893688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.896010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.896010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.897101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.897234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1001ad5-580a-4ea8-aedf-7c41d92b0262 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.902873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:47.903601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:47.903884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:47.904161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] PATH_INFO: `/v3/projects/93d473e7d71b4eb0ad069e16f46205d3/users/78af8bfe5385436da30d89fa94bd2486/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:47.923205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d473e7d71b4eb0ad069e16f46205d3, user_id=78af8bfe5385436da30d89fa94bd2486, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:47.925544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:47.925689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1055/2071] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:47 2022] POST /identity/v3/users => generated 295 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:47.926945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.938776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c56a8-23bc-4ec7-83b7-a0c6447aa9de admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:47.945940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1017/2072] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:47 2022] PUT /identity/v3/projects/93d473e7d71b4eb0ad069e16f46205d3/users/78af8bfe5385436da30d89fa94bd2486/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:47.949533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:47.976168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:48.018350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.019049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.019382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.019687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] PATH_INFO: `/v3/projects/27243b1d74e94c4ca2926cde44b0cd66/users/6108b5a0589e4eb3bc80dea70b9c957a/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.025554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb1e6-8dbc-4da1-9d9f-29131e668289 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.030503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.031118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.031436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.031714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.032356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.033983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.037838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=27243b1d74e94c4ca2926cde44b0cd66, user_id=6108b5a0589e4eb3bc80dea70b9c957a, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.041256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.044854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1018/2073] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:48.045776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.056354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de29960-342e-4f37-88c9-0c6434a564f8 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.059565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1056/2074] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:47 2022] PUT /identity/v3/projects/27243b1d74e94c4ca2926cde44b0cd66/users/6108b5a0589e4eb3bc80dea70b9c957a/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:48.062529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.124757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.126020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.126020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.126231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.126674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.128305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.130716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af5eed-32e9-4347-9e91-ec236e7570cf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.136101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.136794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.137077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.137351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] PATH_INFO: `/v3/projects/f203675f3f214c008238e506243e1c3f/users/48f4e75074d84a06a52763ecaca9c5d0/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.138583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1019/2075] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:48.139439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.150572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4c16-a5df-4a51-bd7e-b5de2b139a8b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.153899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f203675f3f214c008238e506243e1c3f, user_id=48f4e75074d84a06a52763ecaca9c5d0, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.155343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.155943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.156217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.156486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.156638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.157112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.158723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.171005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1020/2076] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:48.174203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1057/2077] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:48 2022] PUT /identity/v3/projects/f203675f3f214c008238e506243e1c3f/users/48f4e75074d84a06a52763ecaca9c5d0/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:48.174317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.175349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.185270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc589-e2c3-4f2c-9a5c-8300f512d762 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.228898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:48.240191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740d822-ed4e-47e8-982e-9b888d06b757 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.245100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.245679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.246011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.246276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.246943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.248668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.249201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.250099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.250388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.250664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] PATH_INFO: `/v3/projects/93d473e7d71b4eb0ad069e16f46205d3/users/78af8bfe5385436da30d89fa94bd2486/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.252669 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d473e7d71b4eb0ad069e16f46205d3, user_id=78af8bfe5385436da30d89fa94bd2486, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.255355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.259265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1058/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:48.260083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.267245 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1021/2079] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:48 2022] PUT /identity/v3/projects/93d473e7d71b4eb0ad069e16f46205d3/users/78af8bfe5385436da30d89fa94bd2486/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:48.268052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.269824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f884-2db0-452a-9cd0-652a50ebf315 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.308518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:48.338876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.339238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd763b7f-f8e1-47d3-82f6-fdde35f7ab29 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.339588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.339879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.340151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] PATH_INFO: `/v3/projects/27243b1d74e94c4ca2926cde44b0cd66/users/6108b5a0589e4eb3bc80dea70b9c957a/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.342114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27243b1d74e94c4ca2926cde44b0cd66, user_id=6108b5a0589e4eb3bc80dea70b9c957a, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.344401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.344762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b006be-522a-402b-bad4-afd9d3dcc38a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.345116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.345974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.345974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] PATH_INFO: `/v3/projects/f203675f3f214c008238e506243e1c3f/users/48f4e75074d84a06a52763ecaca9c5d0/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.347827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f203675f3f214c008238e506243e1c3f, user_id=48f4e75074d84a06a52763ecaca9c5d0, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.350500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e3e27-4565-459f-b3cf-3103479b1f91 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.358544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1059/2080] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:48 2022] PUT /identity/v3/projects/27243b1d74e94c4ca2926cde44b0cd66/users/6108b5a0589e4eb3bc80dea70b9c957a/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:48.359639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3f16-9257-4b49-8ecb-c64adc40789d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.359924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3f16-9257-4b49-8ecb-c64adc40789d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.360200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b3f16-9257-4b49-8ecb-c64adc40789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.373679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1022/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:48 2022] PUT /identity/v3/projects/f203675f3f214c008238e506243e1c3f/users/48f4e75074d84a06a52763ecaca9c5d0/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:48.375615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.376043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.376196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.390449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6d1b3f16-9257-4b49-8ecb-c64adc40789d None None] MFA Rules not processed for user `78af8bfe5385436da30d89fa94bd2486`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:48.391901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6d1b3f16-9257-4b49-8ecb-c64adc40789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:48.408993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] MFA Rules not processed for user `6108b5a0589e4eb3bc80dea70b9c957a`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:48.410497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:48.478653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1060/2082] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:48.480049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.480341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.480621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.505680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1023/2083] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:48.506434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.508059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:48.515774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] MFA Rules not processed for user `48f4e75074d84a06a52763ecaca9c5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:48.517080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:48.580230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a41ee-74a8-484f-9468-409a7d8c92e0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.584250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.584867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.585149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.585421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.593276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:48.595827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.597309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1061/2084] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:48.597680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.598237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.599792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:48.610832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1024/2085] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:48.611592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa0e92-7855-4c0f-8f1f-16bb23cba337 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.615478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.616078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.616359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.616631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.626596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.628081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.640104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1062/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:48.684508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.685893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.693975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4c34-325e-48e9-84d6-fa2d2ce6ea3f service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.698679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.699314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.699600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.699877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.700068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b5277-ffb2-4acf-bafa-b7bf3b1b9f7a service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.704271 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.704865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.705147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.705419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.725642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:48.760939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.762312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.766520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:48.768044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:48.771614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1025/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:48.779522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1063/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:48.960779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:48.972362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f9198-29ee-4d62-aa9f-a84002303e25 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:48.977897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:48.978896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:48.979415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:48.979884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:48.982565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:49.088691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:49.090427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:49.103543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1026/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:49.758487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:49.768616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfad9f-5bd9-4a1e-90c7-54b95f984148 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:49.776520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:49.777052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:49.777335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:49.777615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:49.868495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:49.870926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2e687-bc53-48f4-8ec6-75048ce04e05 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:49.885551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1064/2090] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:50.073106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.187444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace76d-c4e7-416a-856c-a2eeae62fb8b service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.192917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.194008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.194433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.195075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] PATH_INFO: `/v3/users/879ed41ae6ea43b2b9b1e0893ce239f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.197648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=879ed41ae6ea43b2b9b1e0893ce239f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.199943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.248278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.268855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879ed41ae6ea43b2b9b1e0893ce239f1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:50.269521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879ed41ae6ea43b2b9b1e0893ce239f1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:50.293395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879ed41ae6ea43b2b9b1e0893ce239f1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:50.305439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879ed41ae6ea43b2b9b1e0893ce239f1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:50.308239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879ed41ae6ea43b2b9b1e0893ce239f1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:50.338899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1027/2091] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:50 2022] DELETE /identity/v3/users/879ed41ae6ea43b2b9b1e0893ce239f1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:50.343181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.343488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.343764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.365051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:50.366577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:50.456715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1065/2092] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:50.479337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.481378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:50.577128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815632b4-47d7-4814-a914-1368c978b28f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.583802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.583802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.583802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.583802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.611204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.615511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.627921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1028/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:50.753589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:50.755430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:50.833475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d7692-3d9e-4549-b950-42bd92a2c359 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:50.838869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:50.839552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:50.840180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:50.840610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:50.843047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:50.868986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:50.939408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:50.941674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:50.957041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1066/2094] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:51.048570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.050953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:51.080338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97933f5-08bd-49e2-bea5-799398befd01 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.093640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.094218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.094787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.094787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] PATH_INFO: `/v3/projects/4707086a284248acae5ba7480f7959c7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.097794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4707086a284248acae5ba7480f7959c7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.100544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.202327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4707086a284248acae5ba7480f7959c7', 'request_id': 'req-c867b1f6-932f-42ab-970e-a1d9f2b163f2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.214044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4707086a284248acae5ba7480f7959c7', 'request_id': 'req-c867b1f6-932f-42ab-970e-a1d9f2b163f2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.228437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4707086a284248acae5ba7480f7959c7', 'request_id': 'req-c867b1f6-932f-42ab-970e-a1d9f2b163f2'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.241277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] The token cache is being invalidate because project 4707086a284248acae5ba7480f7959c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:51.241573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.243340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.245771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1029/2095] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:51 2022] DELETE /identity/v3/projects/4707086a284248acae5ba7480f7959c7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:51.249548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.264218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171edb06-275d-4618-b7f6-fd85016896f8 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.362442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.363083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.363409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.363687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] PATH_INFO: `/v3/users/6108b5a0589e4eb3bc80dea70b9c957a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.365933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6108b5a0589e4eb3bc80dea70b9c957a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.367954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.418801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6108b5a0589e4eb3bc80dea70b9c957a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.419542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6108b5a0589e4eb3bc80dea70b9c957a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.428146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6108b5a0589e4eb3bc80dea70b9c957a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.429006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6108b5a0589e4eb3bc80dea70b9c957a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.437649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6108b5a0589e4eb3bc80dea70b9c957a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.455753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1067/2096] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:51 2022] DELETE /identity/v3/users/6108b5a0589e4eb3bc80dea70b9c957a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:51.751816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:51.753610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:51.768610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b1f6-932f-42ab-970e-a1d9f2b163f2 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:51.801584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:51.831330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:51.831972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:51.832312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:51.832588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] PATH_INFO: `/v3/projects/27243b1d74e94c4ca2926cde44b0cd66` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:51.833716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27243b1d74e94c4ca2926cde44b0cd66)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:51.835807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:51.885660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27243b1d74e94c4ca2926cde44b0cd66', 'request_id': 'req-71c172cf-0e5f-4c2f-bfad-e42046be3e21'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.892888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27243b1d74e94c4ca2926cde44b0cd66', 'request_id': 'req-71c172cf-0e5f-4c2f-bfad-e42046be3e21'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.899111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27243b1d74e94c4ca2926cde44b0cd66', 'request_id': 'req-71c172cf-0e5f-4c2f-bfad-e42046be3e21'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.910177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] The token cache is being invalidate because project 27243b1d74e94c4ca2926cde44b0cd66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:51.910466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.911109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-71c172cf-0e5f-4c2f-bfad-e42046be3e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:51.912632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1030/2097] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:51 2022] DELETE /identity/v3/projects/27243b1d74e94c4ca2926cde44b0cd66 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:52.569638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:52.571285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:52.586254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326cd60-6243-493b-a33e-166fdaa69510 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:52.616367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:52.650198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:52.650805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:52.651023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:52.651327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] PATH_INFO: `/v3/users/b9c49252a9e04b7fa6608674de7f86ae` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:52.652436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c49252a9e04b7fa6608674de7f86ae)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:52.654495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:52.702203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c49252a9e04b7fa6608674de7f86ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:52.703252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c49252a9e04b7fa6608674de7f86ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:52.712156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c49252a9e04b7fa6608674de7f86ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:52.712796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c49252a9e04b7fa6608674de7f86ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:52.722845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c49252a9e04b7fa6608674de7f86ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:52.743108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1068/2098] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:52 2022] DELETE /identity/v3/users/b9c49252a9e04b7fa6608674de7f86ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:52.747930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:52.748406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:52.748543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:52.768681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:52.769914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:52.837709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1031/2099] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:52.848936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:52.850652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:52.915621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875e629-2467-471f-b7f5-efb3be17e851 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:52.919289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:52.919898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:52.920177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:52.920448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:52.930107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:52.931616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:52.941434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1069/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:53.213247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:53.214689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:53.230654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e8ba-dde1-496b-8a12-46fcc6ad1442 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:53.236582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:53.237269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:53.237482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:53.237758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] PATH_INFO: `/v3/projects/b81b36997cee44a88bddbfbfc71d50d9` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:53.238933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81b36997cee44a88bddbfbfc71d50d9)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:53.240828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:53.293654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81b36997cee44a88bddbfbfc71d50d9', 'request_id': 'req-6e7a0c1e-415c-46de-87ab-18ed564af5b5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.302613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81b36997cee44a88bddbfbfc71d50d9', 'request_id': 'req-6e7a0c1e-415c-46de-87ab-18ed564af5b5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.306324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:53.310291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81b36997cee44a88bddbfbfc71d50d9', 'request_id': 'req-6e7a0c1e-415c-46de-87ab-18ed564af5b5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.324231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] The token cache is being invalidate because project b81b36997cee44a88bddbfbfc71d50d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:53.324536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.325225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.330017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1032/2101] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:53 2022] DELETE /identity/v3/projects/b81b36997cee44a88bddbfbfc71d50d9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:53.331213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:53.340940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9c83-13c4-465c-ab08-9278d3751b44 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:53.397817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:53.408952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:53.409604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:53.410252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:53.410616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] PATH_INFO: `/v3/users/5b25d127c31b458c95befdda231fbb35` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:53.411992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b25d127c31b458c95befdda231fbb35)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:53.415014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:53.465352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b25d127c31b458c95befdda231fbb35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.465932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b25d127c31b458c95befdda231fbb35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.474554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b25d127c31b458c95befdda231fbb35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.475228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b25d127c31b458c95befdda231fbb35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.483027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b25d127c31b458c95befdda231fbb35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:53.501349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1070/2102] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:53 2022] DELETE /identity/v3/users/5b25d127c31b458c95befdda231fbb35 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:53.831959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:53.833946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:53.864034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0c1e-415c-46de-87ab-18ed564af5b5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:53.974246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:53.974952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:53.975198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:53.975481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] PATH_INFO: `/v3/projects/fefefeb7807246c1a9d4a0dfef678b83` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:53.976867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fefefeb7807246c1a9d4a0dfef678b83)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:53.979291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.063659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fefefeb7807246c1a9d4a0dfef678b83', 'request_id': 'req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.073894 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fefefeb7807246c1a9d4a0dfef678b83', 'request_id': 'req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.081217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fefefeb7807246c1a9d4a0dfef678b83', 'request_id': 'req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.097888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] The token cache is being invalidate because project fefefeb7807246c1a9d4a0dfef678b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:54.098355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.099994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.105171 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1033/2103] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:53 2022] DELETE /identity/v3/projects/fefefeb7807246c1a9d4a0dfef678b83 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:54.106465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.108028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.123763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a08e347-299e-4479-abb4-d4c5dc327387 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.188083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.188739 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.189016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.189292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] PATH_INFO: `/v3/users/78af8bfe5385436da30d89fa94bd2486` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.190468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78af8bfe5385436da30d89fa94bd2486)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.193042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.264949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78af8bfe5385436da30d89fa94bd2486'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.265691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78af8bfe5385436da30d89fa94bd2486'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.273998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78af8bfe5385436da30d89fa94bd2486'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.274951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78af8bfe5385436da30d89fa94bd2486'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.284892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b310b934-0d20-4987-890a-774e797123f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78af8bfe5385436da30d89fa94bd2486'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.294253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:54.309952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1071/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:54 2022] DELETE /identity/v3/users/78af8bfe5385436da30d89fa94bd2486 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:54.452692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.458671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.477112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72690f3-392d-40cc-9a5e-0e6ab4bb165a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.547065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.547646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.547934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.548195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] PATH_INFO: `/v3/users/393aa8916e86447f9cf6e59474a934ae` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.549323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=393aa8916e86447f9cf6e59474a934ae)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.551279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.573439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:54.603997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '393aa8916e86447f9cf6e59474a934ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.604655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '393aa8916e86447f9cf6e59474a934ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.612716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '393aa8916e86447f9cf6e59474a934ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.620798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '393aa8916e86447f9cf6e59474a934ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.621488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '393aa8916e86447f9cf6e59474a934ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.639874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1034/2105] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:54 2022] DELETE /identity/v3/users/393aa8916e86447f9cf6e59474a934ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:54.644338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773992-2f30-4100-9c3d-15235734e227 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.644626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773992-2f30-4100-9c3d-15235734e227 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.644899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83773992-2f30-4100-9c3d-15235734e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.665845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-83773992-2f30-4100-9c3d-15235734e227 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:54.667068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-83773992-2f30-4100-9c3d-15235734e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.736710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1072/2106] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:54.743751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.745240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.810404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a7da8-614c-426b-8502-6da89957b8db admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.813997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.814610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.814893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.815204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.825614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.827103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.839125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1035/2107] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:54.844537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773992-2f30-4100-9c3d-15235734e227 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:54.845980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-83773992-2f30-4100-9c3d-15235734e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:54.862608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83773992-2f30-4100-9c3d-15235734e227 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:54.871949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:54.872691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:54.873044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:54.873949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] PATH_INFO: `/v3/projects/93d473e7d71b4eb0ad069e16f46205d3` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:54.875994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d473e7d71b4eb0ad069e16f46205d3)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:54.879294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:54.950186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d473e7d71b4eb0ad069e16f46205d3', 'request_id': 'req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.959082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d473e7d71b4eb0ad069e16f46205d3', 'request_id': 'req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.968878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d473e7d71b4eb0ad069e16f46205d3', 'request_id': 'req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.987138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] The token cache is being invalidate because project 93d473e7d71b4eb0ad069e16f46205d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:54.987757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.988666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:54.990518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1073/2108] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:54 2022] DELETE /identity/v3/projects/93d473e7d71b4eb0ad069e16f46205d3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:55.174713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.176484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:55.210746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054069a-798b-4a4d-88b5-78417865149b service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.285060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.286699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:55.323727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.324451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.324846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.325217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] PATH_INFO: `/v3/projects/4c331a66bfd441ffa74793661d2864af` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.326752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c331a66bfd441ffa74793661d2864af)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.329093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.371311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c3e5d-e663-4ba3-8020-4e51e9d35757 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.378385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.379225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.379607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.379980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] PATH_INFO: `/v3/users/fe7b103f327041b3916e8c8a427496a8` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.381447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7b103f327041b3916e8c8a427496a8)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.383863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.398559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.400061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.412893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c331a66bfd441ffa74793661d2864af', 'request_id': 'req-28fbace1-7f15-4368-8af1-f4375bed1a2d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.429286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c331a66bfd441ffa74793661d2864af', 'request_id': 'req-28fbace1-7f15-4368-8af1-f4375bed1a2d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.448794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c331a66bfd441ffa74793661d2864af', 'request_id': 'req-28fbace1-7f15-4368-8af1-f4375bed1a2d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.463478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] The token cache is being invalidate because project 4c331a66bfd441ffa74793661d2864af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:55.463967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.464079 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7b103f327041b3916e8c8a427496a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.464679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7b103f327041b3916e8c8a427496a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.464859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.467607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1036/2109] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:55 2022] DELETE /identity/v3/projects/4c331a66bfd441ffa74793661d2864af => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:55.472663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7b103f327041b3916e8c8a427496a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.473304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7b103f327041b3916e8c8a427496a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.474239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.477204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:55.485913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-69d07d89-5810-482c-880a-f2992410784e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7b103f327041b3916e8c8a427496a8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.512257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1074/2110] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:55 2022] DELETE /identity/v3/users/fe7b103f327041b3916e8c8a427496a8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:55.517366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.517779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.517907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.548329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:55.549744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:55.569731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbace1-7f15-4368-8af1-f4375bed1a2d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.624278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1075/2111] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:55.634559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:55.636266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:55.645247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.645892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.646168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.646437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] PATH_INFO: `/v3/users/5f631e15e4574db8bb9872c157ba6f48` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.647637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f631e15e4574db8bb9872c157ba6f48)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.651010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.706018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ae870-02fe-428a-9db4-41d8fe92a6d8 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:55.709941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:55.710574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:55.710895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:55.711356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:55.716507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f631e15e4574db8bb9872c157ba6f48'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.717516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f631e15e4574db8bb9872c157ba6f48'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.721717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:55.723331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:55.726678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f631e15e4574db8bb9872c157ba6f48'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.734909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1076/2112] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:15:55.741606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f631e15e4574db8bb9872c157ba6f48'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.744005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f631e15e4574db8bb9872c157ba6f48'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:55.759407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:55.773759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1037/2113] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:55 2022] DELETE /identity/v3/users/5f631e15e4574db8bb9872c157ba6f48 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:56.379181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.379181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:56.402227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf79959-549a-477f-ac0f-32d244d323a9 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.435039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.436585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:56.476886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:56.526782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.527137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.527602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.527984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] PATH_INFO: `/v3/projects/b501c2a0bcd54d779f309e1456e8dde5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.529953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b501c2a0bcd54d779f309e1456e8dde5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.532206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.599302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497dd59-3cb6-49f7-9ad7-9b1336d74e01 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.606750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b501c2a0bcd54d779f309e1456e8dde5', 'request_id': 'req-59d2a0e7-8076-43e9-a176-d831d83e72cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.618129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b501c2a0bcd54d779f309e1456e8dde5', 'request_id': 'req-59d2a0e7-8076-43e9-a176-d831d83e72cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.639045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b501c2a0bcd54d779f309e1456e8dde5', 'request_id': 'req-59d2a0e7-8076-43e9-a176-d831d83e72cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.651997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] The token cache is being invalidate because project b501c2a0bcd54d779f309e1456e8dde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:56.652346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.653015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.654732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1077/2114] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:56 2022] DELETE /identity/v3/projects/b501c2a0bcd54d779f309e1456e8dde5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:56.658337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.660474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:56.679007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.679733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.680085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.680360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] PATH_INFO: `/v3/projects/119caba3e6fa45c3aade7f1c005fd788` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.682060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=119caba3e6fa45c3aade7f1c005fd788)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.684528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.740660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2a0e7-8076-43e9-a176-d831d83e72cd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:56.744803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119caba3e6fa45c3aade7f1c005fd788', 'request_id': 'req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.752678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119caba3e6fa45c3aade7f1c005fd788', 'request_id': 'req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.759185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119caba3e6fa45c3aade7f1c005fd788', 'request_id': 'req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.773710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] The token cache is being invalidate because project 119caba3e6fa45c3aade7f1c005fd788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:56.774120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.776055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cd98f0cf-1f35-43ea-b99b-b3334fbfc4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.783638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1038/2115] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:56 2022] DELETE /identity/v3/projects/119caba3e6fa45c3aade7f1c005fd788 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:56.785057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3a98-e84d-45da-a094-b5965a2039bb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.785337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3a98-e84d-45da-a094-b5965a2039bb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.785611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f3a98-e84d-45da-a094-b5965a2039bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.809287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ff3f3a98-e84d-45da-a094-b5965a2039bb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:56.810641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ff3f3a98-e84d-45da-a094-b5965a2039bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:56.819730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:56.820830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.821409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.821824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] PATH_INFO: `/v3/users/53bcf34d4efc4db79830040335393d7c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.823328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bcf34d4efc4db79830040335393d7c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:56.826074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:56.847244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:56.849349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:56.900940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bcf34d4efc4db79830040335393d7c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.901636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bcf34d4efc4db79830040335393d7c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.905583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1039/2116] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:56.915630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:56.915825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:56.916101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:56.918528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bcf34d4efc4db79830040335393d7c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.920886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bcf34d4efc4db79830040335393d7c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.935443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bcf34d4efc4db79830040335393d7c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:56.943115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:56.944685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:56.961389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1040/2117] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:56.965660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:56.973897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1078/2118] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:56 2022] DELETE /identity/v3/users/53bcf34d4efc4db79830040335393d7c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:56.974955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eb482-47ed-4418-85cb-4e7fc52c2360 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.070837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.072226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.072576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.072929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.073762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:57.074170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.076306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.095682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1041/2119] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:15:57.104423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.119540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4cb5a-42b7-4370-979f-3c97a565f377 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.124365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.125019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.125379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.125677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.126263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.128348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.178690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1079/2120] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:57 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:57.183622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.197798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcd97d-d6d9-42ca-9e17-c52c0281c975 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.270449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.271072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.271399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.271675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.272333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.274962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.307086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1042/2121] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:57 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:57.311471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.327975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673508c9-5afe-4d57-a762-5f9b10f5071a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.337046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.337845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.338266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.338546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.339362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.341245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.356844 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1080/2122] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:57.368181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.376116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:57.385599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.399800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92845b3-509e-4acb-8f42-dcef465a5308 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.405627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.406291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.407114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.407400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] PATH_INFO: `/v3/projects/b50a7257cf5949f485d6a27c3a07b898` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.408591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50a7257cf5949f485d6a27c3a07b898)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.410526 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.414323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d87d78-9be9-400b-9fc5-080ecf49c034 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.422662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.423313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.423598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.423975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.424634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.426379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.451052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1081/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:57.457788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.471418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2551eb-7d5b-47c0-b5de-cde7b79ec0fd admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.483676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:57.487144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50a7257cf5949f485d6a27c3a07b898', 'request_id': 'req-4d8c6113-1d22-4d28-b8b0-baf31bb12491'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.504571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50a7257cf5949f485d6a27c3a07b898', 'request_id': 'req-4d8c6113-1d22-4d28-b8b0-baf31bb12491'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.516806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50a7257cf5949f485d6a27c3a07b898', 'request_id': 'req-4d8c6113-1d22-4d28-b8b0-baf31bb12491'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.541310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] The token cache is being invalidate because project b50a7257cf5949f485d6a27c3a07b898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:57.541703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.542621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.545346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1043/2124] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:57 2022] DELETE /identity/v3/projects/b50a7257cf5949f485d6a27c3a07b898 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:57.549965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.551982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:57.572908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.573588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.573867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.574141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] PATH_INFO: `/v3/projects/c8a2cf3918a64bd08f2bdd2a6d8b6b7d/users/83fba2edef534acca4e499cbbf61707d/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.594195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a2cf3918a64bd08f2bdd2a6d8b6b7d, user_id=83fba2edef534acca4e499cbbf61707d, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.598355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8891b82-53b8-4b5f-add7-cee2dbb6e004 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.623239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1082/2125] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:57 2022] PUT /identity/v3/projects/c8a2cf3918a64bd08f2bdd2a6d8b6b7d/users/83fba2edef534acca4e499cbbf61707d/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:57.629054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.629380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.629548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.649341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c6113-1d22-4d28-b8b0-baf31bb12491 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.660359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] MFA Rules not processed for user `83fba2edef534acca4e499cbbf61707d`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:57.661832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:57.687132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:57.723294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.724138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.724296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.724453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] PATH_INFO: `/v3/users/48f4e75074d84a06a52763ecaca9c5d0` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.725729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f4e75074d84a06a52763ecaca9c5d0)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.728449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.748977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1083/2126] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:57.753414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.754928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:57.771690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485252f4-8592-4f8c-84aa-3d54ed629db2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:57.776488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:57.777255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:57.777539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:57.777809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:57.778442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:57.780803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:57.785200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f4e75074d84a06a52763ecaca9c5d0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.786107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f4e75074d84a06a52763ecaca9c5d0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.796786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f4e75074d84a06a52763ecaca9c5d0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.809191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f4e75074d84a06a52763ecaca9c5d0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.810254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f4e75074d84a06a52763ecaca9c5d0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:57.826027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1084/2127] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:57 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:57.827216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:57.829513 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:57.831507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:57.841994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1044/2128] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:57 2022] DELETE /identity/v3/users/48f4e75074d84a06a52763ecaca9c5d0 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:57.948701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278ec5f-1691-4ad2-ac62-ca0108605d17 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.037793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.038789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.038789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.039277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.039906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.041943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.082518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1085/2129] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:57 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:58.086767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.098063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad14d39-908c-4751-9763-b79c72c00890 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.103652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.104259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.104603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.104815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.105469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.107741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.124706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1045/2130] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:58.128709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.140884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b17-9dba-49e8-853a-f7b20bc3e052 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.146077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.146697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.146976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.147405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.148099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.149970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.161952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1086/2131] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:58.166410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.177065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3018-0b70-4f63-bfbb-6e6ae55a1913 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.182900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.183599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.183883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.184253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] PATH_INFO: `/v3/projects/59cac27d4402412d81278b711fd99ecf/users/cfdd5b004366440a8da45189ec514540/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.207529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cac27d4402412d81278b711fd99ecf, user_id=cfdd5b004366440a8da45189ec514540, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.210742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7153411-c163-43d0-82d0-c090506cc926 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.227603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1046/2132] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:58 2022] PUT /identity/v3/projects/59cac27d4402412d81278b711fd99ecf/users/cfdd5b004366440a8da45189ec514540/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:15:58.237051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.238401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.238697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.238974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.239066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.256630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715457fc-623d-4260-be59-c279bb2f6f4f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.289634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] MFA Rules not processed for user `cfdd5b004366440a8da45189ec514540`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.291740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.292326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:58.335147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.335873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.336371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.336810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] PATH_INFO: `/v3/projects/f203675f3f214c008238e506243e1c3f` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.338569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f203675f3f214c008238e506243e1c3f)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.340556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.368580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1047/2133] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:58.370911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.383698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67211c0-3dd5-45b7-8c38-d8611e7f952b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.395728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f203675f3f214c008238e506243e1c3f', 'request_id': 'req-c5014520-b022-493b-996a-e190d8c35760'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.402002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f203675f3f214c008238e506243e1c3f', 'request_id': 'req-c5014520-b022-493b-996a-e190d8c35760'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.410267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f203675f3f214c008238e506243e1c3f', 'request_id': 'req-c5014520-b022-493b-996a-e190d8c35760'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.426133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] The token cache is being invalidate because project f203675f3f214c008238e506243e1c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:58.426463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.427238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c5014520-b022-493b-996a-e190d8c35760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.435276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1087/2134] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:58 2022] DELETE /identity/v3/projects/f203675f3f214c008238e506243e1c3f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:58.437645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58282e2-896e-4402-aa76-a63092edebc3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.437645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58282e2-896e-4402-aa76-a63092edebc3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.437942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58282e2-896e-4402-aa76-a63092edebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.455228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.455847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.456407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.456688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.457324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.459321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.465464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d58282e2-896e-4402-aa76-a63092edebc3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.467110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d58282e2-896e-4402-aa76-a63092edebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.480522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1088/2135] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:58.489685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b91a-57bf-413e-834f-55fcd6d4555d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.490074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b91a-57bf-413e-834f-55fcd6d4555d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.490264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9b91a-57bf-413e-834f-55fcd6d4555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.500435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1048/2136] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:58.505444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.510107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.521114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b1f9b91a-57bf-413e-834f-55fcd6d4555d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.524723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b1f9b91a-57bf-413e-834f-55fcd6d4555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.579478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:58.611826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1089/2137] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:15:58.614576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b843a0-3600-48bc-8dd4-04cd4d672905 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.616962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42dce2-ef66-448c-8e01-2dfb50aa3fee None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.617552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42dce2-ef66-448c-8e01-2dfb50aa3fee None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.618443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42dce2-ef66-448c-8e01-2dfb50aa3fee None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.620244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.620926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1090/2138] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:15:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:58.621058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.621279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.621617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.622120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42dce2-ef66-448c-8e01-2dfb50aa3fee None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.622230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.624176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8e59-05e3-4367-8d68-8616be0fc57e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.653721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42dce2-ef66-448c-8e01-2dfb50aa3fee None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.659700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.660777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.661660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.662308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.663129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:58.663600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.665613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.669243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1049/2139] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:58.669243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.669243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.669243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.682200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1091/2140] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:58.683249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.687125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.691900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.693090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.701282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e85be-f840-4401-a599-6596fb1c1cce admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.706645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.707382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.707733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.708075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] PATH_INFO: `/v3/users/07e7376d67e840b3bf79524b756e993b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.709550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e7376d67e840b3bf79524b756e993b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.711971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.748684 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:58.765156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1050/2141] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:58.765495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e7376d67e840b3bf79524b756e993b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.766078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e7376d67e840b3bf79524b756e993b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.766193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.777197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f9fc6-3f55-46f0-8dc5-13738f38bc0c None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.779908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e7376d67e840b3bf79524b756e993b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.780939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e7376d67e840b3bf79524b756e993b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.782471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.783076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.783396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.783814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.784456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.786183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.790149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2a321d2f-03f2-40b7-956b-10ac20d29983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e7376d67e840b3bf79524b756e993b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:58.797625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1051/2142] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:58.798425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.800157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.812794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1092/2143] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:15:58 2022] DELETE /identity/v3/users/07e7376d67e840b3bf79524b756e993b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:58.814091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.814407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.814681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.816093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1093/2144] 10.222.0.20 () {54 vars in 961 bytes} [Mon Sep 19 11:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:15:58.816759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.816859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e6ff3-ed0a-466b-b1da-f40bf4ede6dd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.818485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.888139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.888760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.889210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.889594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.890600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.892975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20c3c7-a695-43dd-8187-596aa0f4a7a1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.897778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182c60-f378-42f6-b393-cde9f19dd136 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:58.903185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:58.904203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.904203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.904501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] PATH_INFO: `/v3/projects/864fd998ee0a4c4391b6ad1026d760a2/users/abcb805e35e64f688823740bc4e2a4a3/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.925433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=864fd998ee0a4c4391b6ad1026d760a2, user_id=abcb805e35e64f688823740bc4e2a4a3, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:58.925756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1052/2145] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:58.926829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:58.927133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:58.927447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:58.932508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:58.950354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1094/2146] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:58 2022] PUT /identity/v3/projects/864fd998ee0a4c4391b6ad1026d760a2/users/abcb805e35e64f688823740bc4e2a4a3/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:58.951612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:58.953069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:58.954550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:58.995288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.032951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0aeb7f-443e-4dcf-8f60-48b30dcf2aaa admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.034882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1053/2147] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:59.035783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.045857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.046562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.046840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.047296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.047400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9b05a-2626-4133-be20-2f6d50428331 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.047778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.049763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.052507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.053118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.053400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.053673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.054450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.056264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.068406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1054/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:59.072552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.073874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.080170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1095/2149] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:58 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:59.080170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.088573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a046-5868-4de9-ab6d-21f033631bca admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.091521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb125bf6-aa36-4675-865e-74e9d9219184 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.093972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.094611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.094896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.095229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] PATH_INFO: `/v3/projects/827be97b96f84769b2e2e45041863f10` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.096445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] RBAC: Authorizing `identity:delete_project(project_id=827be97b96f84769b2e2e45041863f10)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.096958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.097550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.097831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.098107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.098783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.099975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.112006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.113599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.123918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1096/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:59.124538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.134996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224fe90-20fb-4918-b9d0-703985effeb5 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.140224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.140884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.141168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.141447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] PATH_INFO: `/v3/projects/864fd998ee0a4c4391b6ad1026d760a2/users/abcb805e35e64f688823740bc4e2a4a3/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.143598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864fd998ee0a4c4391b6ad1026d760a2, user_id=abcb805e35e64f688823740bc4e2a4a3, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.146338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.149656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.157718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827be97b96f84769b2e2e45041863f10', 'request_id': 'req-b179a485-236f-4171-a076-ac640c7d852e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:59.162778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1097/2151] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:59 2022] PUT /identity/v3/projects/864fd998ee0a4c4391b6ad1026d760a2/users/abcb805e35e64f688823740bc4e2a4a3/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:59.163646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.170692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827be97b96f84769b2e2e45041863f10', 'request_id': 'req-b179a485-236f-4171-a076-ac640c7d852e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:59.177900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827be97b96f84769b2e2e45041863f10', 'request_id': 'req-b179a485-236f-4171-a076-ac640c7d852e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:59.193533 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] The token cache is being invalidate because project 827be97b96f84769b2e2e45041863f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:15:59.193826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:59.194612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b179a485-236f-4171-a076-ac640c7d852e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:15:59.196945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1055/2152] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:15:59 2022] DELETE /identity/v3/projects/827be97b96f84769b2e2e45041863f10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:59.198614 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8d7-1086-4a64-a524-01f00c9e446d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.199327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8d7-1086-4a64-a524-01f00c9e446d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.199608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070d8d7-1086-4a64-a524-01f00c9e446d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.229893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-1070d8d7-1086-4a64-a524-01f00c9e446d None None] MFA Rules not processed for user `abcb805e35e64f688823740bc4e2a4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:59.231024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1070d8d7-1086-4a64-a524-01f00c9e446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.236260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7b052-8ab3-4af3-9cbc-80d313951192 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.241011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.241617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.242045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.242459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.243102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.244745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa64f3e-97c1-427b-93f0-fff867ff694a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.254976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1098/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:59.256975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.257262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.258113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.278734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:59.280779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.290384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1099/2154] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:59.290813 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.297659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.310334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1056/2155] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:59.311101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c048c88-7eb2-4114-87e8-3e047af97f53 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.312296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b62721-981d-435f-b80a-630b6788a571 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.312587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b62721-981d-435f-b80a-630b6788a571 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.312872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b62721-981d-435f-b80a-630b6788a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.317612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.318001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.318448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.318726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.319404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.321981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.336637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1100/2156] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:15:59.336637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.336637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.338316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-30b62721-981d-435f-b80a-630b6788a571 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:59.339596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-30b62721-981d-435f-b80a-630b6788a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.348161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1057/2157] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:59.348801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b62721-981d-435f-b80a-630b6788a571 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.361121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b62721-981d-435f-b80a-630b6788a571 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.366339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.367350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.367635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.367907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] PATH_INFO: `/v3/projects/765c49a658ff43bdaf6cbc152ff98a77/users/6d7a6cd9dad9445694967eeca9cce961/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.384826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=765c49a658ff43bdaf6cbc152ff98a77, user_id=6d7a6cd9dad9445694967eeca9cce961, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.387543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.404966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc1aff-0504-413c-96ba-54a7e35031e9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.407651 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1058/2158] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:59 2022] PUT /identity/v3/projects/765c49a658ff43bdaf6cbc152ff98a77/users/6d7a6cd9dad9445694967eeca9cce961/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:59.412267 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.419937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.469814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.470628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.471074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.471504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.473737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.488668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931f17-4d72-4864-8835-301e61e1c86b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.493790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.494409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.494688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.494962 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.495654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:15:59.495955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.497581 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8114c66-b068-4cfd-8751-69ea6e619c7d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.510268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1059/2159] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:15:59.511597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.511911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.512181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.524730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.543949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.546004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.547440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] MFA Rules not processed for user `6d7a6cd9dad9445694967eeca9cce961`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:59.548648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.556381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1101/2160] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:59.557114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.569523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9343416-50a7-4b1f-a6fb-3c15f4a541c6 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.576035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.576662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.576945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.577860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.578519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.580547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.613291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1102/2161] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:59.617601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.633393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1060/2162] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:15:59.649469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.651470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:15:59.670700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5432cd-c85b-4cb6-83c9-bdbac30933ff None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.718340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b17d-d453-497a-b308-90058cc0b0c5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.727600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.728532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.729196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.729657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.730525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.732756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.734820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.735630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.735922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.737279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.760367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1103/2163] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:15:59.764646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.779556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e374-4500-4f53-8871-b97d6ffcdc6d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.786360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.787067 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.787493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.787843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.788573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.791435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.801618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:15:59.808708 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1104/2164] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:59.812373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.827221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.829375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58492ee-36b5-4885-b7d4-aebade94a984 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.829503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.837822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.838565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.838941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.839481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.840282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.841127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1061/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:15:59.842285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a49df-f7d9-423f-afe2-99a69e6bc45c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.856004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1105/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:15:59.874089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:15:59.889339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157458-9ac5-43c7-ac26-9b12091cb3f3 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:15:59.895127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:15:59.895923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.896290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.896567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] PATH_INFO: `/v3/projects/658018ee8789463eaf76b2a39a34ae10/users/b1b1cc84ccd54065b97df321d6a5dca1/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.917969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658018ee8789463eaf76b2a39a34ae10, user_id=b1b1cc84ccd54065b97df321d6a5dca1, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:15:59.921284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:15:59.956762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1062/2167] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:15:59 2022] PUT /identity/v3/projects/658018ee8789463eaf76b2a39a34ae10/users/b1b1cc84ccd54065b97df321d6a5dca1/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:15:59.961792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:15:59.962112 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:15:59.962377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:15:59.984673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:15:59.986639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:00.062857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1106/2168] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:00.075099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:00.077953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:00.143257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577d64f-c410-4b9d-9bf9-7d30539a6220 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:00.147120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:00.147814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:00.148157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:00.148982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:00.161622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:00.163080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:00.176251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1063/2169] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:01.201036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:01.244036 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:01.279786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75510806-bd4d-44f0-a662-06cd50cab5b2 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:01.284248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:01.284481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:01.284898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:01.285936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:01.288367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:01.377617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:01.379670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc9a47-81f4-409f-80df-c89f75253460 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:01.392724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1107/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:02.149050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:02.158729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1dece-7d84-468c-ab58-b027d228aebd service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:02.162520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:02.163121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:02.163447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:02.164327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:02.231079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:02.233866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:02.246532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1064/2171] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:04.583268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.584198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.584481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.614910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] MFA Rules not processed for user `b1b1cc84ccd54065b97df321d6a5dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:04.616173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:04.687096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1108/2172] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:04.703888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:04.706730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:04.775302 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:04.805922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600b32-4e4c-4672-8a32-3cd507ab1610 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:04.814088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:04.814718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:04.815334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:04.815621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:04.825768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:04.827815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46cdca4-d36a-4cea-a1f1-f19755febdbb service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:04.838309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1065/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:16:06.585598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:06.587473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:06.609786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5fd55-086b-4962-b574-b8bc26e490ca None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:06.615130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:06.615910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:06.616372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:06.617354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] PATH_INFO: `/v3/users/83fba2edef534acca4e499cbbf61707d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:06.619113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fba2edef534acca4e499cbbf61707d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:06.621172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:06.682759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fba2edef534acca4e499cbbf61707d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:06.683501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fba2edef534acca4e499cbbf61707d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:06.692387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fba2edef534acca4e499cbbf61707d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:06.693269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fba2edef534acca4e499cbbf61707d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:06.702223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d76b57dd-7559-402f-8b35-fba076ceb31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fba2edef534acca4e499cbbf61707d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:06.707413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:06.728878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1109/2174] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:16:06 2022] DELETE /identity/v3/users/83fba2edef534acca4e499cbbf61707d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:06.734059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:06.734543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:06.734642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:06.756941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:06.758893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:06.833138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:06.833414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:06.833687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:06.859486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] MFA Rules not processed for user `b1b1cc84ccd54065b97df321d6a5dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:06.860863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:06.865512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1066/2175] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:16:06.880355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:06.882224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:06.925166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1110/2176] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:16:06.958195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1633fe-4c37-4719-ab26-5bc966858cee None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:06.964667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:06.965504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:06.965776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:06.966215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:06.977637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:06.979378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:06.989792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1067/2177] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:07.463899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:07.466223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:07.493776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f5cae-2f34-493e-87ce-ec35672345df None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:07.500579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:07.501302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:07.501659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:07.502028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] PATH_INFO: `/v3/projects/c8a2cf3918a64bd08f2bdd2a6d8b6b7d` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:07.503332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a2cf3918a64bd08f2bdd2a6d8b6b7d)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:07.508962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:07.575279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a2cf3918a64bd08f2bdd2a6d8b6b7d', 'request_id': 'req-2558f4d3-11a8-40db-ae24-55ce15750a3f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.582752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a2cf3918a64bd08f2bdd2a6d8b6b7d', 'request_id': 'req-2558f4d3-11a8-40db-ae24-55ce15750a3f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.593416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a2cf3918a64bd08f2bdd2a6d8b6b7d', 'request_id': 'req-2558f4d3-11a8-40db-ae24-55ce15750a3f'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.607687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] The token cache is being invalidate because project c8a2cf3918a64bd08f2bdd2a6d8b6b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:16:07.608246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.608951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.610644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1111/2178] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:16:07 2022] DELETE /identity/v3/projects/c8a2cf3918a64bd08f2bdd2a6d8b6b7d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:07.614863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:07.626803 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb00a-6d63-4b91-9e56-4a20b5f5eacc service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:07.705427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:07.705999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:07.706296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:07.706953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] PATH_INFO: `/v3/users/cfdd5b004366440a8da45189ec514540` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:07.708154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdd5b004366440a8da45189ec514540)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:07.710282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:07.744295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:07.800417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdd5b004366440a8da45189ec514540'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.801131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdd5b004366440a8da45189ec514540'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.817069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdd5b004366440a8da45189ec514540'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.826734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdd5b004366440a8da45189ec514540'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.828068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdd5b004366440a8da45189ec514540'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:07.854443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1068/2179] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:16:07 2022] DELETE /identity/v3/users/cfdd5b004366440a8da45189ec514540 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:08.218431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:08.220807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:08.244804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f4d3-11a8-40db-ae24-55ce15750a3f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:08.334827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:08.335841 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:08.336260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:08.336742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] PATH_INFO: `/v3/projects/59cac27d4402412d81278b711fd99ecf` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:08.338975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cac27d4402412d81278b711fd99ecf)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:08.342376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:08.371850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:08.431695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cac27d4402412d81278b711fd99ecf', 'request_id': 'req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.439169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cac27d4402412d81278b711fd99ecf', 'request_id': 'req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.450355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cac27d4402412d81278b711fd99ecf', 'request_id': 'req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.465436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] The token cache is being invalidate because project 59cac27d4402412d81278b711fd99ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:16:08.465800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.475543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.478236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1112/2180] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:16:08 2022] DELETE /identity/v3/projects/59cac27d4402412d81278b711fd99ecf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:08.483424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:08.485008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:08.505707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2ba38-956b-45bb-8c3d-01f8533d424b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:08.616164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:08.617875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:08.618378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:08.618927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] PATH_INFO: `/v3/users/abcb805e35e64f688823740bc4e2a4a3` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:08.621630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcb805e35e64f688823740bc4e2a4a3)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:08.625678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:08.699490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcb805e35e64f688823740bc4e2a4a3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.700825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcb805e35e64f688823740bc4e2a4a3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.715042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcb805e35e64f688823740bc4e2a4a3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.727563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcb805e35e64f688823740bc4e2a4a3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.728335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-1734dbff-1a60-4f82-8a70-2a3e8de60095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcb805e35e64f688823740bc4e2a4a3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:08.770496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1069/2181] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:16:08 2022] DELETE /identity/v3/users/abcb805e35e64f688823740bc4e2a4a3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:16:09.169692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.171367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:09.206781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11849cc-6b6d-4f00-8fd4-fcc8eb054218 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.286573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.287894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.288397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.289032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] PATH_INFO: `/v3/projects/864fd998ee0a4c4391b6ad1026d760a2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.292976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864fd998ee0a4c4391b6ad1026d760a2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.295141 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.354535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864fd998ee0a4c4391b6ad1026d760a2', 'request_id': 'req-2fc99886-de05-49c9-ae5e-281fb54c09f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:09.360561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864fd998ee0a4c4391b6ad1026d760a2', 'request_id': 'req-2fc99886-de05-49c9-ae5e-281fb54c09f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:09.369456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864fd998ee0a4c4391b6ad1026d760a2', 'request_id': 'req-2fc99886-de05-49c9-ae5e-281fb54c09f8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:09.384508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] The token cache is being invalidate because project 864fd998ee0a4c4391b6ad1026d760a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:16:09.384720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:09.385384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2fc99886-de05-49c9-ae5e-281fb54c09f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:09.387278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1113/2182] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:16:09 2022] DELETE /identity/v3/projects/864fd998ee0a4c4391b6ad1026d760a2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:09.391772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.392308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.392587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.417472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:09.419547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:09.448310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:09.517112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1070/2183] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:16:09.525910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.526203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.526481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.555574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:09.557119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:09.572412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.579361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1114/2184] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:09.584308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a5a48-5119-4ebc-b285-03ceee163ed7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.598653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.599244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.599534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.599810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.600473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:16:09.600784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.605836 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.626431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1071/2185] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:16:09.631660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.645528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0192e1-33cf-499b-bb1b-e504833f725f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.655864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.656510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.656783 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.657066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.657870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.659876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.704561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1115/2186] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:16:09 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:09.709984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.720628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb3031-8b1d-4e00-a974-68f42ebe3986 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.792486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.793095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.793463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.794009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.794627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.797048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.822680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1072/2187] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:16:09 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:09.827435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.834780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:09.840911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e000d0-136d-490d-a71c-3515939dfee5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.847900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.848665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.848960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.849367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.850246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.852943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.867715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1116/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:16:09.872445 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.884676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e00e7-6a8c-4fdc-8d8c-8c777fe5191b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.889574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.890186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.890467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.890747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.891451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.893078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91293742-3f57-4759-924f-06b764ea5e60 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.905756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1073/2189] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:16:09.910419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:09.922051 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095631-b96f-4e7d-bb15-40631ef6b0d8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:09.927231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:09.927922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.928209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.928488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] PATH_INFO: `/v3/projects/c6e37d4e9a0640fc9c21cab4c9839d27/users/acb3f7fdb4cb48698c2e56b1638ea4e7/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:09.945758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e37d4e9a0640fc9c21cab4c9839d27, user_id=acb3f7fdb4cb48698c2e56b1638ea4e7, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:09.948503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:09.962669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1117/2190] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:16:09 2022] PUT /identity/v3/projects/c6e37d4e9a0640fc9c21cab4c9839d27/users/acb3f7fdb4cb48698c2e56b1638ea4e7/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:09.973103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:09.973398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:09.973678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:10.004632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] MFA Rules not processed for user `acb3f7fdb4cb48698c2e56b1638ea4e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:10.006006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:10.089609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1074/2191] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:10.097710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:10.099479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:10.195689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677feaf-36df-4368-9de9-27361ca91a27 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:10.199589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:10.200205 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:10.200489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:10.200773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:10.210724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:10.212461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9578bc-cd34-4f55-afc9-bf55f9ba633f service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:10.236064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1118/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:10.744825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:10.746492 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:10.776903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:10.853789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa0139-8d0e-4a1e-aa0f-64f5cc508f7f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:10.859802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:10.860472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:10.860753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:10.861336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] PATH_INFO: `/v3/users/6d7a6cd9dad9445694967eeca9cce961` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:10.862563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7a6cd9dad9445694967eeca9cce961)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:10.864861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:10.918689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7a6cd9dad9445694967eeca9cce961'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:10.919545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7a6cd9dad9445694967eeca9cce961'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:10.930340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7a6cd9dad9445694967eeca9cce961'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:10.938470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7a6cd9dad9445694967eeca9cce961'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:10.939281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7a6cd9dad9445694967eeca9cce961'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:10.962539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1075/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:16:10 2022] DELETE /identity/v3/users/6d7a6cd9dad9445694967eeca9cce961 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:10.966786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:10.967090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:10.967395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:10.987712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:10.988937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:11.055707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1119/2194] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:11.066035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:11.067420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:11.142740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfe168-144b-4b57-9f60-3e22e547c5c4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:11.146450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:11.147054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:11.147361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:11.147631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:11.159192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:11.160630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78372fa-4018-40ed-877d-36d1a6add972 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:11.177886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1076/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:11.551090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:11.553045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:11.579763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47bdf2-5631-43c3-a8db-ac96e8638df0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:11.597517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:11.598678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:11.598989 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:11.599685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] PATH_INFO: `/v3/projects/765c49a658ff43bdaf6cbc152ff98a77` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:11.600924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765c49a658ff43bdaf6cbc152ff98a77)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:11.605216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:11.661317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:11.667955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765c49a658ff43bdaf6cbc152ff98a77', 'request_id': 'req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:11.676888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765c49a658ff43bdaf6cbc152ff98a77', 'request_id': 'req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:11.687286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765c49a658ff43bdaf6cbc152ff98a77', 'request_id': 'req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:11.699617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] The token cache is being invalidate because project 765c49a658ff43bdaf6cbc152ff98a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:16:11.699917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:11.700587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:11.702096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1120/2196] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:16:11 2022] DELETE /identity/v3/projects/765c49a658ff43bdaf6cbc152ff98a77 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:21.170469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:21.696476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:31.052388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74539-b051-4a6a-8855-73e6a1b5122c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:31.052913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74539-b051-4a6a-8855-73e6a1b5122c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:31.053076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74539-b051-4a6a-8855-73e6a1b5122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:31.075137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ddc74539-b051-4a6a-8855-73e6a1b5122c None None] MFA Rules not processed for user `c0f3bbc3da1e49b184d357a7cc34f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:31.076421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ddc74539-b051-4a6a-8855-73e6a1b5122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:31.131609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1077/2197] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:35.361044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:35.362727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:35.449587 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ef33c-56fa-48fd-80b5-6be1f2c2eaf6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:35.454645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:35.456056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:35.456341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:35.456609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] PATH_INFO: `/v3/users/acb3f7fdb4cb48698c2e56b1638ea4e7` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:35.458324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb3f7fdb4cb48698c2e56b1638ea4e7)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:35.460833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:35.532804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb3f7fdb4cb48698c2e56b1638ea4e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:35.533572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb3f7fdb4cb48698c2e56b1638ea4e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:35.544707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb3f7fdb4cb48698c2e56b1638ea4e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:35.545534 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb3f7fdb4cb48698c2e56b1638ea4e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:35.555573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb3f7fdb4cb48698c2e56b1638ea4e7'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:35.577311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1121/2198] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:16:35 2022] DELETE /identity/v3/users/acb3f7fdb4cb48698c2e56b1638ea4e7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:35.582012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:35.582609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:35.582609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:35.604271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:35.605489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:35.687555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1078/2199] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:35.698711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:35.700403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:35.778927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172110e-e2bd-402c-8735-72f184e53d39 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:35.784154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:35.784781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:35.785069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:35.785345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:35.798795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:35.800215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb9520-f941-4f61-93f9-f5d9b90b4e7c service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:35.812995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1122/2200] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:36.187070 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.188573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:36.200993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49666353-3100-43ee-9b8e-f59abed117e0 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.205872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.206507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.206833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.207066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] PATH_INFO: `/v3/projects/c6e37d4e9a0640fc9c21cab4c9839d27` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.208204 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e37d4e9a0640fc9c21cab4c9839d27)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.210924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.266208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e37d4e9a0640fc9c21cab4c9839d27', 'request_id': 'req-b0ab07b4-57ac-4768-b5ec-756fee7ff513'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:36.274987 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e37d4e9a0640fc9c21cab4c9839d27', 'request_id': 'req-b0ab07b4-57ac-4768-b5ec-756fee7ff513'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:36.282157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e37d4e9a0640fc9c21cab4c9839d27', 'request_id': 'req-b0ab07b4-57ac-4768-b5ec-756fee7ff513'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:36.296089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] The token cache is being invalidate because project c6e37d4e9a0640fc9c21cab4c9839d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:16:36.296383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:36.297055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b0ab07b4-57ac-4768-b5ec-756fee7ff513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:16:36.298561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1079/2201] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:16:36 2022] DELETE /identity/v3/projects/c6e37d4e9a0640fc9c21cab4c9839d27 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:36.304022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.304292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.304573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.324407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:36.325626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:36.344189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:36.398851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1123/2202] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:36.406712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.406992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.407296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.427984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:36.429474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:36.437207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1080/2203] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:36.441605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.452949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9368-6ec8-4fb9-8a71-343a3b247ef0 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.457852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.458516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.458851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.459202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.460466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:16:36.460814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.462639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.474623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1124/2204] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:16:36.479822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.489138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac9fb-b4fa-45f5-aab4-3f7c247a79d5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.493995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.494594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.494875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.495148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.495811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.497724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.523036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:36.533975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1081/2205] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:16:36 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:36.535495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.547292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba9da-0374-488b-b1e7-a5ad0ee7b95c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.603939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.604461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.604741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.605016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.605640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.607612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.628803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1125/2206] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:16:36 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:16:36.633319 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.644265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270cbc-c651-4aef-8746-e956236c6967 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.650304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.650941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.651247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.651524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.652186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.653809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.664490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1082/2207] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:16:36.668843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.679212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a499fdd-3800-4364-86c3-610f6f097574 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.684211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.684822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.685098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.685397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.686068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.687759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61740f89-3895-4f47-83a9-fbd4c772aacd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.700870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1126/2208] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:16:36.705202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.716337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4bc5-60a7-46ca-a54b-fb9b5274850f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.721118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.722854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.722854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.722854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] PATH_INFO: `/v3/projects/a83ba916313543e8bb2aa7c7a99c12b2/users/fc0fda318d084cd588040e659a7908e0/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.741381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83ba916313543e8bb2aa7c7a99c12b2, user_id=fc0fda318d084cd588040e659a7908e0, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.744247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.759453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1083/2209] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:16:36 2022] PUT /identity/v3/projects/a83ba916313543e8bb2aa7c7a99c12b2/users/fc0fda318d084cd588040e659a7908e0/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:16:36.770342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e48fa-952a-4168-855b-9f32ebf36201 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.770637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e48fa-952a-4168-855b-9f32ebf36201 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.770912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e48fa-952a-4168-855b-9f32ebf36201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.806068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-951e48fa-952a-4168-855b-9f32ebf36201 None None] MFA Rules not processed for user `fc0fda318d084cd588040e659a7908e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:36.807435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-951e48fa-952a-4168-855b-9f32ebf36201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:36.888426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1127/2210] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:36.901516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:36.903392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:36.964633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5f511-4220-454e-8529-65ac447fb794 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:36.968534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:36.969230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:36.969509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:36.969775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:36.979901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:36.981380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674113f9-08e6-4ad3-b7af-b7ffa78511c5 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:36.990720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1084/2211] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:16:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:16:46.885216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:46.986895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:48.232589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:48.233094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:48.233282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:48.253788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] MFA Rules not processed for user `59fb0a1e033f4f94aa83d339946d34eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:48.255019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:48.314592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1128/2212] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:58.288538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:58.289043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:58.289144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:58.307733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=25 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:16:58.313566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:16:58.314997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:58.382262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1085/2213] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:16:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:16:58.428639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:16:58.430071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:16:58.523619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf0e6e-dda8-4f29-9965-68e2fdd408f9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:16:58.529338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:16:58.530078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:16:58.530360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:16:58.530632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:16:58.539300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:16:58.540874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ce08-2ece-4847-aae9-34084e5e3453 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:16:58.552761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1129/2214] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:17:08.383880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=25 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:08.548120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=32 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:11.930746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:11.997397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d5591-e8fc-4cd0-b5b1-b12139adb891 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:12.002035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:12.002671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.002948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.003255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] PATH_INFO: `/v3/users/fc0fda318d084cd588040e659a7908e0` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.004385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0fda318d084cd588040e659a7908e0)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:12.006335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:12.071000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0fda318d084cd588040e659a7908e0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.071907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0fda318d084cd588040e659a7908e0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.080519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0fda318d084cd588040e659a7908e0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.087586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0fda318d084cd588040e659a7908e0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.088327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0fda318d084cd588040e659a7908e0'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.106236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1086/2215] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:17:11 2022] DELETE /identity/v3/users/fc0fda318d084cd588040e659a7908e0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:17:12.110794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.111355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.111499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.131237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:12.132397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:12.193773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1130/2216] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:12.207474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:12.209047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:12.269842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd15a4d-20d9-4f88-9e7e-696e57d9f444 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:12.274489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:12.275101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.275415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.275800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.285837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:12.287338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859ea6-2887-48ad-b9c0-c0b489ea2916 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:12.298826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1087/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:12.575638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:12.577088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:12.591635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93858d70-0a91-4dd8-ae71-bc2ef365626f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:12.596295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:12.596925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.597213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.597488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] PATH_INFO: `/v3/projects/a83ba916313543e8bb2aa7c7a99c12b2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.598617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83ba916313543e8bb2aa7c7a99c12b2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:12.600613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:12.650081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83ba916313543e8bb2aa7c7a99c12b2', 'request_id': 'req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.656278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83ba916313543e8bb2aa7c7a99c12b2', 'request_id': 'req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.664688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83ba916313543e8bb2aa7c7a99c12b2', 'request_id': 'req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.677439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] The token cache is being invalidate because project a83ba916313543e8bb2aa7c7a99c12b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:17:12.677737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.678400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ce8f9b6b-7135-45c2-ba59-8a1f78fee8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:17:12.679937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1131/2218] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:17:12 2022] DELETE /identity/v3/projects/a83ba916313543e8bb2aa7c7a99c12b2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:17:12.685837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.686313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.686587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.708966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:12.710311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:12.737580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:12.795665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1088/2219] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:12.803441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.803801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.804150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.826211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:12.827487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:12.836852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1132/2220] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:12.841438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:12.851910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4a7ab-f43c-4081-ac6b-9bba63f84259 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:12.857014 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:12.857735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.858021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.858299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.858946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:17:12.859293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:12.861063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:12.874011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1089/2221] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:17:12.878372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:12.888644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394c199-c3b6-40fd-93d4-62c9e0578cb9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:12.893729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:12.894343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:12.894620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:12.894896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:12.895572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:12.897743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:12.925838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1133/2222] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:17:12.930124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:12.941673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ee6da-8bb3-4d4b-a3fe-3434c6657865 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:13.000303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:13.000917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.001202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.001481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.002119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:13.004148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:13.026142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1090/2223] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:17:12 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:17:13.030565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:13.041149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581f8f6-e322-4421-9bbc-b69e55b0a7a3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:13.046527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:13.047363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.047646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.048477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.048731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:13.050294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:13.066435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1134/2224] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:17:13.067766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:13.078243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239746b1-40f5-4f9c-9e50-f6d1c292c160 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:13.082989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:13.083777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.084061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.084343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.084977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:13.086573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae857d80-0541-4864-980b-7da4859e804d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:13.098560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1091/2225] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:17:13.102804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:13.114425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45156e4-a8c2-44df-89d1-8c31319c5552 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:13.119448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:13.120130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.120434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.120712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] PATH_INFO: `/v3/projects/e0bf545be989477a83ded48109216a57/users/5b01b0e511e1447aaa7414e3e3cd23c8/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.136175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bf545be989477a83ded48109216a57, user_id=5b01b0e511e1447aaa7414e3e3cd23c8, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:13.138934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:13.154273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1135/2226] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:17:13 2022] PUT /identity/v3/projects/e0bf545be989477a83ded48109216a57/users/5b01b0e511e1447aaa7414e3e3cd23c8/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:17:13.159177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144dc6-e304-4dd5-ba2a-9018dfcf475c None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.159474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144dc6-e304-4dd5-ba2a-9018dfcf475c None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.159749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1144dc6-e304-4dd5-ba2a-9018dfcf475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.180801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c1144dc6-e304-4dd5-ba2a-9018dfcf475c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:13.182008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c1144dc6-e304-4dd5-ba2a-9018dfcf475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.246092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1092/2227] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:13.257238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:13.258961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.295070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:13.330085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ece22-20bb-4d19-b218-b66c7e3fd1d1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:13.334499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:13.335120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.335441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.335714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.346814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:13.348291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4b3b-81ba-4ee7-b7b7-0b69e8ba6ab9 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:13.358612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1136/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:13.890537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.890875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.891112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.892843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1093/2229] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:17:13.898957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073733-d380-4489-937a-40751154d648 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:13.899392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073733-d380-4489-937a-40751154d648 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:13.899765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6073733-d380-4489-937a-40751154d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:13.922228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c6073733-d380-4489-937a-40751154d648 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:13.923614 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c6073733-d380-4489-937a-40751154d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:13.996869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1137/2230] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:17:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:14.009253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:14.011516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.047766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:14.076764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0343-7366-4f62-8267-2dfb8b1ddcb2 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:14.080751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:14.081254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.081528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.081794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.092757 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:14.094341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6d665-774a-4d6a-b85c-1c4f89dbc2f3 service glance] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:14.111452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1094/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:14.157635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.158531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.158957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.187543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fe86-54f8-4016-85d9-cbee275d85e8 None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.188091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fe86-54f8-4016-85d9-cbee275d85e8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.188908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44fe86-54f8-4016-85d9-cbee275d85e8 None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.190465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1095/2232] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:17:14.191723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] MFA Rules not processed for user `5b01b0e511e1447aaa7414e3e3cd23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:14.193220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.195121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.196131 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.196494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.220078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] MFA Rules not processed for user `478e89a2c7c74b65a7008a49b08ef93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:14.221601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.229700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1096/2233] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:14.243054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:14.255388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2eb52-1fe7-4c56-aa4e-e5a246d15b86 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:14.259793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:14.260773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.261051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.261318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.275309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1138/2234] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:14.276075 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:14.286959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:14.288446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb77358-1b08-410c-8db5-4014397701ce service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:14.289802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.298181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1097/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:17:14.351381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:14.364987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b841d6-a7b2-4d39-8ba1-e77418456932 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:14.368868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:14.369531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.370006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.370425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.379969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:14.381551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a65b9-268a-423d-bddd-50b6802be02b service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:14.391593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.391885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.392173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1139/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:17:14.392299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] PATH_INFO: `/` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.393564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1098/2237] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 19 11:17:14.398909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeee9b6-f73f-4bd1-a87b-8db970273623 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.399299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeee9b6-f73f-4bd1-a87b-8db970273623 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.399494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeee9b6-f73f-4bd1-a87b-8db970273623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.420554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-aeeee9b6-f73f-4bd1-a87b-8db970273623 None None] MFA Rules not processed for user `a8f507682b7f425ba842a46ad98d9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:14.421754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-aeeee9b6-f73f-4bd1-a87b-8db970273623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.431210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1140/2238] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:17:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:14.442450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:14.444369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:14.458123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c8d2e-37fd-4c76-8c5c-6ffa589d56bb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:14.461898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:14.462551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:14.462906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:14.463865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:14.474923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:14.476511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202e1fd-5d87-47dd-8c55-eedfce25589d service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:14.492989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1099/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:15.887639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:15.888108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:15.888201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:15.907866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] MFA Rules not processed for user `5b01b0e511e1447aaa7414e3e3cd23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:15.909070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:15.919030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1141/2240] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:17.517703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d618-574e-4def-975d-60fb55606861 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:17.518562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d618-574e-4def-975d-60fb55606861 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:17.518847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d618-574e-4def-975d-60fb55606861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:17.539061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-be96d618-574e-4def-975d-60fb55606861 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:17.540312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-be96d618-574e-4def-975d-60fb55606861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:17.610506 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1100/2241] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:17:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:17.624071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:17.625553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:17.704454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240f08-cc2a-4dfe-8c97-36a709ed7648 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:17.710620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:17.711279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:17.711566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:17.711836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:17.721496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:17.723467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:17.733726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1142/2242] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:17:27.601645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=53 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:27.729396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=44 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:34.932175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:34.932745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:34.933128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:34.971497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:34.972840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:34.984560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1101/2243] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:34.998938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:35.010038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ed54e-8871-45e3-971e-22d291de36b5 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:35.015842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:35.016355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:35.016692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:35.016913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:35.026522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:35.028173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0e066-67df-4475-9dbb-0f5ac3602138 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:35.039013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1143/2244] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:17:43.918475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:43.921084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:44.029071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9f76-dd71-4329-a4e2-0ba2c289ef3e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:44.034799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:44.035627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:44.035978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:44.036330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:44.038194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:44.051101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:44.054120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06878c95-a569-4681-9a2c-f0a44f944a2d service placement] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:44.064645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1102/2245] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:17:45.036595 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=6 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:54.060137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=35 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:54.842911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:54.843579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:54.843579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:54.863985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] MFA Rules not processed for user `c0f3bbc3da1e49b184d357a7cc34f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:54.865357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:54.923381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1144/2246] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:58.384632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf24dc-6ba2-45c6-9e67-608fae29cc46 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:58.385681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf24dc-6ba2-45c6-9e67-608fae29cc46 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:58.385865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf24dc-6ba2-45c6-9e67-608fae29cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:58.413542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-47bf24dc-6ba2-45c6-9e67-608fae29cc46 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:17:58.415443 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-47bf24dc-6ba2-45c6-9e67-608fae29cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:58.427567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1103/2247] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:17:58.448582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:17:58.450551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:17:58.474956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c4069-bc65-420f-9985-9db9afa5f518 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:17:58.484386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:17:58.486035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:17:58.486315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:17:58.486640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:17:58.497058 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:17:58.498681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:17:58.511506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1145/2248] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:01.424268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c43c-480b-49bc-a08d-b4fdae67d4e0 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:01.424809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c43c-480b-49bc-a08d-b4fdae67d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:01.425144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09c43c-480b-49bc-a08d-b4fdae67d4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:01.445842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7a09c43c-480b-49bc-a08d-b4fdae67d4e0 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:01.447089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7a09c43c-480b-49bc-a08d-b4fdae67d4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:01.455620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1104/2249] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:01.470621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:01.482617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559efe85-d961-46b4-bdd6-07896a66cfc5 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:01.488342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:01.489021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:01.489515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:01.489788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:01.498328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:01.500030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:01.510228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1146/2250] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:05.737372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8227-624c-4f3e-a6eb-e352fec76172 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:05.737920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8227-624c-4f3e-a6eb-e352fec76172 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:05.737920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee8227-624c-4f3e-a6eb-e352fec76172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:05.758010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-06ee8227-624c-4f3e-a6eb-e352fec76172 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:05.759259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-06ee8227-624c-4f3e-a6eb-e352fec76172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:05.767115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1105/2251] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:05.791150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:05.803377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4029cb-f5df-46cb-861c-4f03743d3371 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:05.809433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:05.810042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:05.810323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:05.810601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:05.819410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:05.821011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:05.831625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1147/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:08.833216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dd7f-f530-46d8-a48f-5fb582355173 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:08.833688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dd7f-f530-46d8-a48f-5fb582355173 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:08.833809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3dd7f-f530-46d8-a48f-5fb582355173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:08.854731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fbd3dd7f-f530-46d8-a48f-5fb582355173 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:08.856652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fbd3dd7f-f530-46d8-a48f-5fb582355173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:08.864697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1106/2253] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:18:08.884290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:08.885692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:08.900905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863e07-c376-4d1d-9450-1ef16f76d90a service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:08.906879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:08.907503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:08.907782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:08.908053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:08.916339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:08.918575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:08.928786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1148/2254] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:13.020672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc496-8f97-4f13-9ef0-8a198ee15249 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:13.021160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc496-8f97-4f13-9ef0-8a198ee15249 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:13.021253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc496-8f97-4f13-9ef0-8a198ee15249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:13.043105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-9c9dc496-8f97-4f13-9ef0-8a198ee15249 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:13.044457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9c9dc496-8f97-4f13-9ef0-8a198ee15249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:13.052414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1107/2255] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:13.067304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:13.079286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166989-0085-44a7-9937-1482dc6e6d0c service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:13.085114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:13.085725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:13.086003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:13.086272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:13.095907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:13.097507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:13.108303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1149/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:16.181841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f94e-87d1-4d55-b931-ee61ae42a1fc None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:16.182337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f94e-87d1-4d55-b931-ee61ae42a1fc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:16.182449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f94e-87d1-4d55-b931-ee61ae42a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:16.203842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8719f94e-87d1-4d55-b931-ee61ae42a1fc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:16.205135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8719f94e-87d1-4d55-b931-ee61ae42a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:16.213113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1108/2257] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:16.234990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:18:16.243081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=56 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:16.251179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e69fbb-d580-4772-81be-493310738e79 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:18:16.257108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:18:16.257712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:16.257990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:16.258262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:16.266831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:18:16.268462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed57aa4-2a68-4a6f-bf59-5512af651f9e service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:18:16.278759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1150/2258] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:26.197933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=18 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:26.273602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:28.720751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7840f-5487-4b25-af5d-7f30680b5c3f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:28.721275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7840f-5487-4b25-af5d-7f30680b5c3f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:28.721385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7840f-5487-4b25-af5d-7f30680b5c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:28.740349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f9e7840f-5487-4b25-af5d-7f30680b5c3f None None] MFA Rules not processed for user `59fb0a1e033f4f94aa83d339946d34eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:28.741556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f9e7840f-5487-4b25-af5d-7f30680b5c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:28.797399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1109/2259] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:38.790438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=25 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:41.571211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7f16-116b-4b42-a03d-bfde726ad9af None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:41.572106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7f16-116b-4b42-a03d-bfde726ad9af None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:41.572411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a7f16-116b-4b42-a03d-bfde726ad9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:41.592613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-3a1a7f16-116b-4b42-a03d-bfde726ad9af None None] MFA Rules not processed for user `cc4e6ebb70d2450ab66c68b19d82b7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:41.594192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3a1a7f16-116b-4b42-a03d-bfde726ad9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:41.664388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1151/2260] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:18:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:44.074556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:18:44.075233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:18:44.075233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:18:44.095136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] MFA Rules not processed for user `5b01b0e511e1447aaa7414e3e3cd23c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:18:44.096406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:18:44.103389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1110/2261] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:18:51.657365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=25 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:54.089003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:01.149233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d975-08b9-47d9-9095-6301ac3d2234 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:01.149870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d975-08b9-47d9-9095-6301ac3d2234 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:01.150084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104d975-08b9-47d9-9095-6301ac3d2234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:01.292872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b104d975-08b9-47d9-9095-6301ac3d2234 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:01.294665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b104d975-08b9-47d9-9095-6301ac3d2234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:01.303410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1152/2262] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:01.328632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:01.342174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f3074-56b9-4480-8d45-7bd4fed41322 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:01.348799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:01.349578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:01.349937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:01.350311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:01.362388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:01.364545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:01.378599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1111/2263] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:06.580214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc66ec-93f3-4cca-8cdc-3e48b1fac0ef None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:06.580941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc66ec-93f3-4cca-8cdc-3e48b1fac0ef None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:06.580941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc66ec-93f3-4cca-8cdc-3e48b1fac0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:06.604250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2abc66ec-93f3-4cca-8cdc-3e48b1fac0ef None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:06.605617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2abc66ec-93f3-4cca-8cdc-3e48b1fac0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:06.614107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1153/2264] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:06.631341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:06.645088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8274-123c-4661-873d-6f5a19fe494b service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:06.652221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:06.653441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:06.653739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:06.654270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:06.670490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:06.672389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946a652-13a6-4271-9f09-c5cb808b3635 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:06.683699 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1112/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:09.582882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:09.583892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:09.583892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:09.604919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] MFA Rules not processed for user `c0f3bbc3da1e49b184d357a7cc34f058`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:09.606562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:09.615416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1154/2266] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:09.672809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d421f-ac0d-4608-a25f-ba52a2ef641d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:09.673177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d421f-ac0d-4608-a25f-ba52a2ef641d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:09.673363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d421f-ac0d-4608-a25f-ba52a2ef641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:09.694106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ea6d421f-ac0d-4608-a25f-ba52a2ef641d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:09.695381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ea6d421f-ac0d-4608-a25f-ba52a2ef641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:09.704588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1113/2267] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:09.720685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:09.733611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e32a8e-6b04-45e5-88e9-0ec20e01e82d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:09.740415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:09.741273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:09.741539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:09.741902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:09.751324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:09.752961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:09.763607 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1155/2268] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:12.865041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605521f-b676-4317-ac19-53e59e8d04b3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:12.865630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605521f-b676-4317-ac19-53e59e8d04b3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:12.865711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605521f-b676-4317-ac19-53e59e8d04b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:12.889750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8605521f-b676-4317-ac19-53e59e8d04b3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:12.891409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8605521f-b676-4317-ac19-53e59e8d04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:12.900834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1114/2269] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:12.933083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:12.946316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46e0b-b169-4860-9b4e-51cabc5dcd28 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:12.953945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:12.954578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:12.954860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:12.955132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:12.964661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:12.966300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:12.977481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1156/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:16.055883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:16.056415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:16.056415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:16.078031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:16.079471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:16.088976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1115/2271] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Sep 19 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:16.131820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:16.143608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223342c-e096-4860-96fb-84cb635a688a service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:16.149163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:16.149763 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:16.150046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:16.150318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:16.159335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:16.160944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:16.172144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1157/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:26.071630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=21 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:26.166496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=27 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:43.387427 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:43.398557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab4b6d-1f0a-4480-bc20-5c526c01f936 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:43.402780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:43.403477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:43.403807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:43.404113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:43.406274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:43.422126 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:43.423765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:43.437140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1116/2273] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:44.555304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:44.565625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f3a91-c25b-4783-acc6-c6314a173275 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:44.569359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:44.569956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:44.570230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:44.570495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:44.572239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:44.596259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:44.597840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1a301-c16c-4da4-80e6-39d759aff9aa service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:44.612188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1158/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:48.181882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:48.191395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c52ac-a7ed-4030-b829-9b3f05128462 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:48.195485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:48.196322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:48.196668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:48.196947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:48.199914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:48.213053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:48.215010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4585d9-c3d2-4bc0-a7aa-59d6e9729c7d service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:48.225652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1117/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:52.026777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.027638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.027638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] PATH_INFO: `/` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.028793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1159/2276] 10.222.0.20 () {54 vars in 921 bytes} [Mon Sep 19 11:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 19 11:19:52.076741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.077379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.077379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.101375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] MFA Rules not processed for user `13f59c80064f44f59abc5defb5515fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:52.102718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.112577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1118/2277] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Sep 19 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:52.134578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.136926 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.162402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.168493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073254db-b032-4cad-8ce3-4d718d013336 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.173652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998abc-3b63-4b18-8232-7ba9eea39014 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.179928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.182663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.182663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.182663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] PATH_INFO: `/v3/users/5b01b0e511e1447aaa7414e3e3cd23c8` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.183247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b01b0e511e1447aaa7414e3e3cd23c8)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.185087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.185444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.186730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.187019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.196779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.221096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.225407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.238316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1160/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:52.255833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b01b0e511e1447aaa7414e3e3cd23c8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.256558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b01b0e511e1447aaa7414e3e3cd23c8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.270933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b01b0e511e1447aaa7414e3e3cd23c8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.288430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b01b0e511e1447aaa7414e3e3cd23c8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.288909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b01b0e511e1447aaa7414e3e3cd23c8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.323260 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1119/2279] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:19:52 2022] DELETE /identity/v3/users/5b01b0e511e1447aaa7414e3e3cd23c8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:19:52.388475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.390269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.412831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157fe2d-ab96-43df-b60d-f51e3a81af5d service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.491906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.492959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.493545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.494104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] PATH_INFO: `/v3/users/59fb0a1e033f4f94aa83d339946d34eb` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.496487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fb0a1e033f4f94aa83d339946d34eb)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.499972 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.559476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fb0a1e033f4f94aa83d339946d34eb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.560275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fb0a1e033f4f94aa83d339946d34eb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.569688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fb0a1e033f4f94aa83d339946d34eb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.570625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fb0a1e033f4f94aa83d339946d34eb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.580216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-45b9c57b-f8c8-4b4a-b1ce-a26f064c188b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fb0a1e033f4f94aa83d339946d34eb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.592201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.593980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.613325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62292a02-a0f8-42a1-95bd-ffbb97a7af37 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.620104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.621602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.622218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.622707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] PATH_INFO: `/v3/projects/e0bf545be989477a83ded48109216a57` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.624340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bf545be989477a83ded48109216a57)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.626966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.636682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1161/2280] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:19:52 2022] DELETE /identity/v3/users/59fb0a1e033f4f94aa83d339946d34eb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:19:52.713475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bf545be989477a83ded48109216a57', 'request_id': 'req-af06aebd-7d8c-4385-9613-dcd5a85a8b37'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.724425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bf545be989477a83ded48109216a57', 'request_id': 'req-af06aebd-7d8c-4385-9613-dcd5a85a8b37'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.745098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bf545be989477a83ded48109216a57', 'request_id': 'req-af06aebd-7d8c-4385-9613-dcd5a85a8b37'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.757977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] The token cache is being invalidate because project e0bf545be989477a83ded48109216a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:19:52.758273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.759192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-af06aebd-7d8c-4385-9613-dcd5a85a8b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:52.762771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1120/2281] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:19:52 2022] DELETE /identity/v3/projects/e0bf545be989477a83ded48109216a57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:19:52.767956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.768326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.768673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.792469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:52.793858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.853950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:52.872613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1162/2282] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:19:52.880871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.881263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.881780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.904481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:52.905914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.918428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1121/2283] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:52.920575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.943687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1196e5-0bec-4034-bf16-282345a52181 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.950004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.950779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.951327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.951732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:52.951847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.952259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.953132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:19:52.954307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.957560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.967265 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d00d3-efad-4417-a904-9027a712fb2e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.972996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.973672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.974428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.974428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] PATH_INFO: `/v3/projects/6c50c1a936574c1b843c7c206a71bdd5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.974590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1163/2284] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:19:52.975837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c50c1a936574c1b843c7c206a71bdd5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.978313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:52.979712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:52.989706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5fd6-4a5f-4b45-bf82-490bcbb5dc25 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:52.992047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:52.995719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:52.996324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:52.996597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:52.996864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:52.997495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:52.999471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.038315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1164/2285] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:19:52 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:19:53.043385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.050333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c50c1a936574c1b843c7c206a71bdd5', 'request_id': 'req-3b78e3a3-2826-4670-a6fc-214ab96f538c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:53.061768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c50c1a936574c1b843c7c206a71bdd5', 'request_id': 'req-3b78e3a3-2826-4670-a6fc-214ab96f538c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:53.068222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c50c1a936574c1b843c7c206a71bdd5', 'request_id': 'req-3b78e3a3-2826-4670-a6fc-214ab96f538c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:53.081663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] The token cache is being invalidate because project 6c50c1a936574c1b843c7c206a71bdd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:19:53.082296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:53.082629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3b78e3a3-2826-4670-a6fc-214ab96f538c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:19:53.084296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1122/2286] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:19:52 2022] DELETE /identity/v3/projects/6c50c1a936574c1b843c7c206a71bdd5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:19:53.091432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85754db-e963-437b-baac-238dbab33d11 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.091716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85754db-e963-437b-baac-238dbab33d11 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.091992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85754db-e963-437b-baac-238dbab33d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.115909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c85754db-e963-437b-baac-238dbab33d11 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:53.116180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b77e-b667-44b3-9ce8-ad23e77fef13 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.117148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c85754db-e963-437b-baac-238dbab33d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.123185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.123918 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.124194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.124468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.125160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.126667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1123/2287] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:53.127319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.133937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.134222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.134503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.150123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1165/2288] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:19:53.154099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.155938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.156720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:53.158315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.167098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1124/2289] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:19:53.169830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c447792-a51d-4e70-bcdf-7a86c36ca252 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.171746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.180460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.181153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.181284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809ad1-23ae-45d6-a8f8-5c3f535050ec None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.181550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.181863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.183945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.186421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.186659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.187310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.187636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.188036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.188730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:19:53.189042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.190657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.202951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1166/2290] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:19:53.212406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1125/2291] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:19:53.212661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.213377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.223642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c998-4b83-4fb5-923e-31775328bcd5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.223963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03029926-c993-4dce-9995-e5cac7701a1b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.229811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.230429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.230913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.231048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.231226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.231381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.231645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.231749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.231929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.232590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.233631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.234222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.251133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1167/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:19:53.255840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.267646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1126/2293] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:19:53.267870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08a46-3460-45e3-8edd-29d6cd98f496 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.268932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.336059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.336876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.337295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.337742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] PATH_INFO: `/v3/projects/98bed0f2138b416c9e27d1b3cc8ca5c4/users/c1e1f0b97ad54efebb8a3cb01e85a34c/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.353299 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb183071-bd82-4af6-8726-b6fcbc8f668e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.357829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bed0f2138b416c9e27d1b3cc8ca5c4, user_id=c1e1f0b97ad54efebb8a3cb01e85a34c, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.359028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.359810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.360114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.360389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.360579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.361041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.363010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e51b4a-5735-47e4-b3f2-3d3f1d509f34 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.377872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1168/2294] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:19:53 2022] PUT /identity/v3/projects/98bed0f2138b416c9e27d1b3cc8ca5c4/users/c1e1f0b97ad54efebb8a3cb01e85a34c/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:19:53.379210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.385800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.395883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1127/2295] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:19:53.395883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.395883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.395883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.399705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:53.419074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:53.420343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.459978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:53.478225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97404640-df6a-4b37-ade9-8e86a668066f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.484828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.485492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.485792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.486105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.489893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.492224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1128/2296] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:53.497021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.509283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea26d7-89a0-41c3-84cb-7b7293f538b4 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.516088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.516861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.517169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.517504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.518409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.520583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.536379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1129/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:19:53.536379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.536687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.561683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.563335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.572542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1169/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:53.573642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.584837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72619b-7ca0-4753-b62c-cda416d45c83 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.590610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.591258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.591540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.591827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.592427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.594063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.604738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c904-50b8-4a22-b57e-e380147168b4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.605960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1170/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:19:53.609656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.609943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.610449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.610816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.611234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.621481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af16c4-3c4f-470c-98a6-989c6ea842c0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.624589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.626448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfe85f-5b61-47da-84d7-c77a47eafd79 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.627361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.628120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.628393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.628667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] PATH_INFO: `/v3/projects/799bf323c35f47fab3b32b885502f62c/users/03608e971df847dc87312dac03c3bc7a/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.640351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1130/2300] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:53.652829 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799bf323c35f47fab3b32b885502f62c, user_id=03608e971df847dc87312dac03c3bc7a, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.655600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.671074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1171/2301] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:19:53 2022] PUT /identity/v3/projects/799bf323c35f47fab3b32b885502f62c/users/03608e971df847dc87312dac03c3bc7a/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:19:53.683036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.683525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.683788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.729621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] MFA Rules not processed for user `03608e971df847dc87312dac03c3bc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:53.730875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:53.816566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1131/2302] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:53.822426 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:53.937645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e2817-50a5-4336-b0f0-3600c31a14d9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:53.946670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:53.948320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:53.948819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:53.949580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:53.950770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:53.954915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:53.986834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:54.010001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1172/2303] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:19:53 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:19:54.014263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.026841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965ffa1-d2f7-4852-ace3-7fb0560d6ad7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.097958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.098668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.098889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.099329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.100347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.103449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.113791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:54.139456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1132/2304] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:19:54 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:19:54.140782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.155590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39614450-286e-41ab-98e1-3c530f43ee7d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.160789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.161409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.161692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.162100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.162751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.164517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.178728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1173/2305] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:19:54.184095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.195274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c481d-de45-4c25-926d-bf20349a289d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.200863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.201550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.201834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.202117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] PATH_INFO: `/v3/projects/97a55350d5cf408e9da28ba64fc5e696/users/adb61e0c9dca477297b89c4ea48db841/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.225934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a55350d5cf408e9da28ba64fc5e696, user_id=adb61e0c9dca477297b89c4ea48db841, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.229174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.253122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1133/2306] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:19:54 2022] PUT /identity/v3/projects/97a55350d5cf408e9da28ba64fc5e696/users/adb61e0c9dca477297b89c4ea48db841/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:19:54.257528 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.274314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb8f76-9683-4d9c-88f4-abb85d03c407 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.360035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.360531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.361192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.361192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.361973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.363968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1ecce-eff5-49c4-b00c-7b4f697137fe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.379222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1174/2307] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:19:54.380372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.392263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3fa0-bffb-414b-bdca-508211205856 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.396993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.397674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.397955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.398219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] PATH_INFO: `/v3/projects/97a55350d5cf408e9da28ba64fc5e696/users/adb61e0c9dca477297b89c4ea48db841/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.400482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a55350d5cf408e9da28ba64fc5e696, user_id=adb61e0c9dca477297b89c4ea48db841, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.403345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.416897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1134/2308] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:19:54 2022] PUT /identity/v3/projects/97a55350d5cf408e9da28ba64fc5e696/users/adb61e0c9dca477297b89c4ea48db841/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:19:54.429341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.429946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.430080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.461774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] MFA Rules not processed for user `adb61e0c9dca477297b89c4ea48db841`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:19:54.463044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:54.537800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1175/2309] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:19:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:19:54.550549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.552388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:19:54.636515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f3b81-28d8-4ea5-bf11-db5064a3cfea admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.640709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.641525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.641868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.642160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.652785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.654284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2eaff-b8e2-44ab-be40-c8a6d5b2f8e9 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.673623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1135/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:19:54.777532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:19:54.789329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd105880-9c83-4420-be07-a32793c2a900 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:19:54.797427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:19:54.798062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:19:54.798345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:19:54.798610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:19:54.894640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:19:54.896796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:19:54.912571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1176/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:19:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:00.833183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:00.834238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:00.836493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:00.873357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] MFA Rules not processed for user `c1e1f0b97ad54efebb8a3cb01e85a34c`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:00.879229 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:01.007034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1136/2312] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:01.012303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.018795 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:01.104314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843c20c-665b-4368-a2e1-6dd92c95e252 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.111421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.112359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.112865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.113578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.114414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.116910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.162639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1177/2313] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:01 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:01.164914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.188145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82eba-dd25-46af-bba0-417fe4862e6f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.261323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:01.286009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.287019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.287659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.288215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.289403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.293888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.332569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1137/2314] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:01 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:01.342850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.354393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097631d-dca6-4ad6-8c97-994d3cf4e57a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.359367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.360022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.360269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.360538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.361178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.362826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.380320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1178/2315] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:01.382007 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.396073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8a79-d45d-4a64-8743-3b4a6eea40e7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.401429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.402234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.402620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.402787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] PATH_INFO: `/v3/projects/c42428e62fe243c0980e5c121c52a20b/users/1bb9ffb70bb8419dbd0400204d86578e/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.424872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42428e62fe243c0980e5c121c52a20b, user_id=1bb9ffb70bb8419dbd0400204d86578e, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.427623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.448461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1138/2316] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:01 2022] PUT /identity/v3/projects/c42428e62fe243c0980e5c121c52a20b/users/1bb9ffb70bb8419dbd0400204d86578e/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:01.451874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.468777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe062bf5-9e17-49c0-ac86-1191b2fd30b6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.551075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.551825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.552107 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.552379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.553022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.554693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f64951-8b8c-4784-ab06-e16668d568ae admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.565880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1179/2317] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:01.570120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:01.581985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957492b6-5911-4d16-b3dc-381ddea06a03 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:01.591969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:01.592685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.593067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.593263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] PATH_INFO: `/v3/projects/c42428e62fe243c0980e5c121c52a20b/users/1bb9ffb70bb8419dbd0400204d86578e/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.596298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42428e62fe243c0980e5c121c52a20b, user_id=1bb9ffb70bb8419dbd0400204d86578e, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:01.599393 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:01.617519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1139/2318] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:01 2022] PUT /identity/v3/projects/c42428e62fe243c0980e5c121c52a20b/users/1bb9ffb70bb8419dbd0400204d86578e/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:01.637868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:01.638161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:01.638579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:01.660416 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] MFA Rules not processed for user `b1b1cc84ccd54065b97df321d6a5dca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:01.663038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:01.742660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1180/2319] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:02.328142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:02.410774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c3acf-0e5d-41c9-8d0d-8eef65cfb47f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:02.415182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:02.415838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:02.416661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:02.417266 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:02.420028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:02.437079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:02.447554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:02.458806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1140/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:03.252352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:03.253846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:03.302994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:03.402042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6a3e1-7d46-4092-8edb-75d3d4139677 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:03.420823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:03.421643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:03.422018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:03.422626 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:03.424820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:03.458552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:03.460466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:03.463078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1fc16-5d2c-47d7-b751-4a8f25350231 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:03.482830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1181/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:03.599643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53486f-ce8f-4fc5-9547-8dc03a20f63e service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:03.607371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:03.608032 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:03.608318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:03.608593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] PATH_INFO: `/v3/users/03608e971df847dc87312dac03c3bc7a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:03.610466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03608e971df847dc87312dac03c3bc7a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:03.613181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:03.712947 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:03.723648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03608e971df847dc87312dac03c3bc7a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:03.725942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03608e971df847dc87312dac03c3bc7a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:03.737814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03608e971df847dc87312dac03c3bc7a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:03.751521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03608e971df847dc87312dac03c3bc7a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:03.757084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03608e971df847dc87312dac03c3bc7a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:03.811431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1141/2322] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:03 2022] DELETE /identity/v3/users/03608e971df847dc87312dac03c3bc7a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:03.816703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b861e6-a6af-4dfb-baa8-271773569ed5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:03.817012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b861e6-a6af-4dfb-baa8-271773569ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:03.817287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b861e6-a6af-4dfb-baa8-271773569ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:03.844689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-45b861e6-a6af-4dfb-baa8-271773569ed5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:03.846683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-45b861e6-a6af-4dfb-baa8-271773569ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:04.032162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1182/2323] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:04.055008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:04.058041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:04.340826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720460af-b23a-4207-8b04-79be26d77320 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:04.348704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:04.349510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:04.350328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:04.350963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:04.379239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:04.382474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:04.404956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1142/2324] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:04.490690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:04.491326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:04.491326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:04.554338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:04.556435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:04.673623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1183/2325] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:20:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:04.972338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:04.974523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:05.205372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8baa4e-a72e-4323-ba84-ea6da77d6823 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:05.213799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:05.214547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:05.214827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:05.215098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:05.232678 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:05.234798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:05.293373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1143/2326] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:20:05.630819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:05.632560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:05.674821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc42058-201a-419a-8747-9ca79bb3683c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:05.706473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:05.707254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:05.707388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:05.707645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] PATH_INFO: `/v3/projects/799bf323c35f47fab3b32b885502f62c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:05.710078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799bf323c35f47fab3b32b885502f62c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:05.717832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:05.963236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799bf323c35f47fab3b32b885502f62c', 'request_id': 'req-c499cf80-c674-4881-9d80-79f98e135f01'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:05.965180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:05.975349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799bf323c35f47fab3b32b885502f62c', 'request_id': 'req-c499cf80-c674-4881-9d80-79f98e135f01'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.009498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799bf323c35f47fab3b32b885502f62c', 'request_id': 'req-c499cf80-c674-4881-9d80-79f98e135f01'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.053368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] The token cache is being invalidate because project 799bf323c35f47fab3b32b885502f62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:06.053368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.054371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.060017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1184/2327] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:05 2022] DELETE /identity/v3/projects/799bf323c35f47fab3b32b885502f62c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:06.063765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:06.086052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00857b8-72b9-4a34-be94-22880994bc83 service swift] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:06.257278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:06.298629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:06.299332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:06.299604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:06.300104 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] PATH_INFO: `/v3/users/adb61e0c9dca477297b89c4ea48db841` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:06.301909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb61e0c9dca477297b89c4ea48db841)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:06.306216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:06.429364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb61e0c9dca477297b89c4ea48db841'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.431386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb61e0c9dca477297b89c4ea48db841'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.456224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb61e0c9dca477297b89c4ea48db841'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.484173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb61e0c9dca477297b89c4ea48db841'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.488256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cb964eba-8611-4e1f-bd91-09ebe250aed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb61e0c9dca477297b89c4ea48db841'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:06.547129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1144/2328] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:06 2022] DELETE /identity/v3/users/adb61e0c9dca477297b89c4ea48db841 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:07.328837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:07.330634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:07.368704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499cf80-c674-4881-9d80-79f98e135f01 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:07.540858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:07.544730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:07.545173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:07.545554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] PATH_INFO: `/v3/projects/97a55350d5cf408e9da28ba64fc5e696` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:07.549432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a55350d5cf408e9da28ba64fc5e696)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:07.554419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:07.777361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a55350d5cf408e9da28ba64fc5e696', 'request_id': 'req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:07.793774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a55350d5cf408e9da28ba64fc5e696', 'request_id': 'req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:07.814592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a55350d5cf408e9da28ba64fc5e696', 'request_id': 'req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:07.851484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] The token cache is being invalidate because project 97a55350d5cf408e9da28ba64fc5e696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:07.851966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:07.852904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-20886f08-b774-4e6b-b8c5-5566d8cbe3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:07.858965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1185/2329] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:07 2022] DELETE /identity/v3/projects/97a55350d5cf408e9da28ba64fc5e696 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:07.865520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:07.866412 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:07.866690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:07.902154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:07.903569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:08.011630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1145/2330] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:08.020281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.020692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.021095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.063862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:08.066106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:08.076760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1186/2331] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:08.083392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.119591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3c339-ded3-4d60-9387-27a737e47144 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.134439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.135367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.135785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.136207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.137088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:08.137601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.139291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.161918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1146/2332] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:08.167958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.181365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f192c-0c04-4042-9a44-095d271e4572 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.189315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.189934 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.190226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.190486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.191129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.195311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.252678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1187/2333] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:08 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:08.256657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.271419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078abb9c-6d6f-49c6-ae86-e68cf9f93f54 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.402466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.405144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.405567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.405856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.406646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.410667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.422086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:08.452760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1147/2334] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:08 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:08.457566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.477699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69264e00-7876-496e-a050-117216cd7a51 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.491056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.492056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.492345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.493814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.495762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.500457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.529676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.540428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1188/2335] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:08.549043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8c5f4-f02e-4e1a-ba2f-8f6afbd3e938 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.555215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.555932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.556282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.557000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.558615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.568546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f4e4e-4ae9-42da-acad-2fc920b72efb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.614684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1148/2336] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:08.616050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:08.629510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd667fba-c231-4804-9ba5-933fcd5d8721 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:08.652908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:08.653604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.653884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.654160 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] PATH_INFO: `/v3/projects/7ca917e9f8da49488d9f5acf3922963d/users/6855b856884a4add89b192adb5366ed8/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.717710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca917e9f8da49488d9f5acf3922963d, user_id=6855b856884a4add89b192adb5366ed8, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:08.720619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:08.791476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1189/2337] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:08 2022] PUT /identity/v3/projects/7ca917e9f8da49488d9f5acf3922963d/users/6855b856884a4add89b192adb5366ed8/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:08.803741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:08.805125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:08.805666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:08.899607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] MFA Rules not processed for user `6855b856884a4add89b192adb5366ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:08.903844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:09.091898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1149/2338] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:09.096411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:09.105336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:09.257905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c1cd7-14d8-4b1c-8a32-0b908d43baa2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:09.272544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:09.273176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:09.273459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:09.273737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:09.274377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:09.292955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:09.383764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1190/2339] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:09 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:09.385907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:09.407892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8eb61-5674-4de5-8978-3a9d339fc168 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:09.534022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:09.536178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:09.536839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:09.537333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:09.538423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:09.543436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:09.596051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1150/2340] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:09 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:09.600380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:09.614302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb5926-54cf-4f3c-9436-4e0a69182661 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:09.620532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:09.621856 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:09.622529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:09.623314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:09.624690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:09.628490 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:09.643612 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1191/2341] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:09.648326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:09.675647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bc32d-fda8-4552-b0f9-7d5c5720ca2c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:09.725561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:09.729818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:09.730409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:09.730866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] PATH_INFO: `/v3/projects/703539edfbf5459ab596fe7753b7cff5/users/084ba10612194a61af2361a965de51f4/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:09.777120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703539edfbf5459ab596fe7753b7cff5, user_id=084ba10612194a61af2361a965de51f4, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:09.788436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:09.820088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1151/2342] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:09 2022] PUT /identity/v3/projects/703539edfbf5459ab596fe7753b7cff5/users/084ba10612194a61af2361a965de51f4/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:09.821303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:09.837984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f24ee-4540-44ad-a7c8-dbcff3d165a7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:10.000099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:10.001679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:10.002488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:10.005570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:10.006429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:10.018847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae6174-32ff-4c29-9683-913bfe0fe8c2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:10.062871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:10.064264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1192/2343] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:10.080667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35103-889c-48f0-845d-5c5c64c0bb78 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:10.089382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:10.090473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:10.090934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:10.091472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] PATH_INFO: `/v3/projects/703539edfbf5459ab596fe7753b7cff5/users/084ba10612194a61af2361a965de51f4/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:10.095801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703539edfbf5459ab596fe7753b7cff5, user_id=084ba10612194a61af2361a965de51f4, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:10.098938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:10.150770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1152/2344] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:10 2022] PUT /identity/v3/projects/703539edfbf5459ab596fe7753b7cff5/users/084ba10612194a61af2361a965de51f4/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:10.163469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:10.163874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:10.164246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:10.232435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] MFA Rules not processed for user `084ba10612194a61af2361a965de51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:10.234643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:10.354039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:10.374604 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1193/2345] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:10.382253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:10.387616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:10.466525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:10.560178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2dcad-a15e-4138-9a4f-a03ceadc8125 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:10.586114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:10.586779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:10.587038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:10.587350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:10.618722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:10.625013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee263358-b6a2-4746-b067-ffdd73773f96 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:10.647323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1153/2346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:10.723870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:10.919722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3356eb-b668-4483-8fc2-d45104487cfc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:10.941224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:10.941910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:10.942195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:10.942468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] PATH_INFO: `/v3/users/6855b856884a4add89b192adb5366ed8` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:10.945148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6855b856884a4add89b192adb5366ed8)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:10.952111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:11.088046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6855b856884a4add89b192adb5366ed8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:11.088750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6855b856884a4add89b192adb5366ed8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:11.105608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6855b856884a4add89b192adb5366ed8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:11.106790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6855b856884a4add89b192adb5366ed8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:11.125801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6855b856884a4add89b192adb5366ed8'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:11.199121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1194/2347] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:10 2022] DELETE /identity/v3/users/6855b856884a4add89b192adb5366ed8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:11.200923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e596-6939-4546-8773-be12d5a47d64 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:11.201421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e596-6939-4546-8773-be12d5a47d64 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:11.201685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090e596-6939-4546-8773-be12d5a47d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:11.250459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-a090e596-6939-4546-8773-be12d5a47d64 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:11.252518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a090e596-6939-4546-8773-be12d5a47d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:11.439619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1154/2348] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:11.450744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:11.452269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:11.538394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:11.538681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:11.539021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:11.550761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8aa3-9d90-43d9-b323-4a7eeee3910f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:11.558702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:11.559359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:11.559641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:11.559914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:11.570751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:11.572560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:11.585345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] MFA Rules not processed for user `1bb9ffb70bb8419dbd0400204d86578e`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:11.586893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:11.607341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1195/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:11.736222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1155/2350] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:11.756852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:11.760721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:11.817047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:11.966591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bf21f-d1bd-4551-b5dd-324a0982d45f service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:11.981123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:11.981768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:11.982049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:11.982716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:11.991261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.121039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:12.122758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69346ef0-60a3-47a3-87e9-6eb74a1f2e04 service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:12.143511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1196/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:12.342177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:12.344919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.397396 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb112209-552b-4915-a3ff-902835cf4f95 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:12.413357 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:12.414151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.414497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.415631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] PATH_INFO: `/v3/projects/7ca917e9f8da49488d9f5acf3922963d` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.424737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca917e9f8da49488d9f5acf3922963d)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:12.432782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:12.570310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:12.582681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca917e9f8da49488d9f5acf3922963d', 'request_id': 'req-6fc2dd6c-686b-4805-979f-a909049aa60b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:12.586436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724124b9-d67d-40c3-a238-89feec493358 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.586723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724124b9-d67d-40c3-a238-89feec493358 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.586998 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724124b9-d67d-40c3-a238-89feec493358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.625069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca917e9f8da49488d9f5acf3922963d', 'request_id': 'req-6fc2dd6c-686b-4805-979f-a909049aa60b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:12.644952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca917e9f8da49488d9f5acf3922963d', 'request_id': 'req-6fc2dd6c-686b-4805-979f-a909049aa60b'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:12.647284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-724124b9-d67d-40c3-a238-89feec493358 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:12.648713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-724124b9-d67d-40c3-a238-89feec493358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.709940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] The token cache is being invalidate because project 7ca917e9f8da49488d9f5acf3922963d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:12.711573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:12.714371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:12.723182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1156/2352] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:12 2022] DELETE /identity/v3/projects/7ca917e9f8da49488d9f5acf3922963d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:12.727034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:12.729608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.868523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1197/2353] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:20:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:12.908809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724124b9-d67d-40c3-a238-89feec493358 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:12.910734 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-724124b9-d67d-40c3-a238-89feec493358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:12.911920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2dd6c-686b-4805-979f-a909049aa60b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:12.939552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:12.940225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:12.940507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:12.940801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] PATH_INFO: `/v3/users/084ba10612194a61af2361a965de51f4` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:12.944293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084ba10612194a61af2361a965de51f4)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:12.946523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:13.050975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084ba10612194a61af2361a965de51f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:13.051653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084ba10612194a61af2361a965de51f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:13.074056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084ba10612194a61af2361a965de51f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:13.084687 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084ba10612194a61af2361a965de51f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:13.086108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084ba10612194a61af2361a965de51f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:13.114660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1157/2354] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:12 2022] DELETE /identity/v3/users/084ba10612194a61af2361a965de51f4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:13.144442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724124b9-d67d-40c3-a238-89feec493358 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:13.210016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:13.319381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:13.323997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:13.324304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:13.324615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:13.331709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:13.524935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:13.527697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3996d8-0b74-46b6-b2d3-745a70f90db8 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:13.539108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1198/2355] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:20:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:20:13.810047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:13.812917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:13.950889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:13.986017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f073fb-d602-43e9-9a84-1c4cbc7b1901 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:14.002035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:14.002707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:14.003002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:14.003279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] PATH_INFO: `/v3/projects/703539edfbf5459ab596fe7753b7cff5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:14.006722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=703539edfbf5459ab596fe7753b7cff5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:14.008718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:14.152318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703539edfbf5459ab596fe7753b7cff5', 'request_id': 'req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:14.171575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703539edfbf5459ab596fe7753b7cff5', 'request_id': 'req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:14.192175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703539edfbf5459ab596fe7753b7cff5', 'request_id': 'req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:14.230098 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] The token cache is being invalidate because project 703539edfbf5459ab596fe7753b7cff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:14.230397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:14.231121 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e12f36a8-882c-4fad-a6e5-1dd8b426d26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:14.236370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1158/2356] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:13 2022] DELETE /identity/v3/projects/703539edfbf5459ab596fe7753b7cff5 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:14.237955 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:14.238747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:14.239231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:14.281669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:14.282912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:14.496440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1199/2357] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:14.505186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:14.505456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:14.505719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:14.561812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:14.563965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:14.601273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1159/2358] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:14.605696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:14.617337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540203e-e5e3-4b10-9eb9-41e96f67493f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:14.649488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:14.651115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:14.651493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:14.651699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:14.652376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:14.652678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:14.654322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:14.704021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:14.719361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1200/2359] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:14.737309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b7f113-ece0-49b9-b8f6-8aae9b652aea None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:14.764378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:14.765891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:14.766623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:14.766623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:14.767059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:14.769879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:14.910694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1160/2360] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:14 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:14.914973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:14.929815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ba730-a6d8-4398-8b8f-8f5b222e697f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:15.119434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:15.153117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:15.153746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.154025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.154298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.154945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:15.157361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:15.209246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1201/2361] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:14 2022] POST /identity/v3/users => generated 287 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:15.213697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:15.229891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e25178-40c2-47b2-aff7-7b9466af72b8 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:15.277114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:15.277759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.278047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.278323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.278991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:15.289277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:15.353657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1161/2362] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:15.356118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:15.373018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf941b-ce32-4d68-877c-89a18e9cf2a1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:15.397975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:15.403196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.403725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.404168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.404987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:15.406782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af6d2f-5c40-4e8b-9143-279da2e3478b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:15.442797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1202/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:15.443870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:15.457608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85152-a480-4eb3-b461-706acd1fc133 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:15.511096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:15.512100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.512388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.512676 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] PATH_INFO: `/v3/projects/c0f8eb7eba734f5694d09c3478200c7c/users/b365a01a04a347e09d638cce0939c5cd/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.579607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f8eb7eba734f5694d09c3478200c7c, user_id=b365a01a04a347e09d638cce0939c5cd, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:15.584144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:15.600388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1162/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:15 2022] PUT /identity/v3/projects/c0f8eb7eba734f5694d09c3478200c7c/users/b365a01a04a347e09d638cce0939c5cd/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:15.617605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:15.618003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:15.618377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:15.735746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] MFA Rules not processed for user `b365a01a04a347e09d638cce0939c5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:15.737015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:16.028284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:16.034563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:16.038953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1203/2365] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:16.231469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27975077-f338-481d-9a9d-eac41786d4ee admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:16.251918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:16.254750 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:16.254952 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:16.258244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:16.316869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:16.318539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:16.354247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1163/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:16.386314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:16.495305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:16.497055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:16.571128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:16.633336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76512a15-adb6-49f6-a90d-b95264c402a1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:16.647409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:16.648069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:16.648346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:16.648660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] PATH_INFO: `/v3/users/b365a01a04a347e09d638cce0939c5cd` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:16.652971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b365a01a04a347e09d638cce0939c5cd)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:16.655715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:16.679279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e637217-472c-476a-b4f4-c3eb218d4f7d service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:16.732252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:16.737663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:16.738425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:16.739355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:16.749617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:16.785260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b365a01a04a347e09d638cce0939c5cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:16.788449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b365a01a04a347e09d638cce0939c5cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:16.794694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:16.803970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b365a01a04a347e09d638cce0939c5cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:16.804695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b365a01a04a347e09d638cce0939c5cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:16.805275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ee27f-34cc-4d6c-8b93-3e0ab126880d service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:16.821447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b365a01a04a347e09d638cce0939c5cd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:16.825620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:16.834281 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1164/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:16.879814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1204/2368] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:16 2022] DELETE /identity/v3/users/b365a01a04a347e09d638cce0939c5cd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:16.881461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:16.881755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:16.882035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:16.918788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:16.920128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:17.087098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:17.087929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1165/2369] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:17.094193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:17.100816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:17.102448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:17.224377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186629-b967-42eb-8ced-df331d7a29ae None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:17.236939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:17.239054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:17.240248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:17.242016 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:17.276936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:17.279904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:17.305233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1166/2370] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:17.343973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bd32-3f85-4cc2-8968-9e2fe06da7da admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:17.353930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:17.354853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:17.355429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:17.355864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:17.358122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:17.470093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:17.473985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3775b5-ec65-4ef6-99f8-2a01085cec5e service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:17.494828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1205/2371] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:18.637936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:18.639643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:18.679585 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189ef3b-c475-4be6-a9ba-59bfff0d6873 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:18.710937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:18.718181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:18.718541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:18.718859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] PATH_INFO: `/v3/projects/c0f8eb7eba734f5694d09c3478200c7c` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:18.724454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f8eb7eba734f5694d09c3478200c7c)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:18.740644 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:18.951813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f8eb7eba734f5694d09c3478200c7c', 'request_id': 'req-864f49b7-a6da-458a-8289-4dea01c7f8cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:18.967706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f8eb7eba734f5694d09c3478200c7c', 'request_id': 'req-864f49b7-a6da-458a-8289-4dea01c7f8cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:18.979518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:18.985379 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f8eb7eba734f5694d09c3478200c7c', 'request_id': 'req-864f49b7-a6da-458a-8289-4dea01c7f8cd'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:19.013983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] The token cache is being invalidate because project c0f8eb7eba734f5694d09c3478200c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:19.014181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:19.015184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-864f49b7-a6da-458a-8289-4dea01c7f8cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:19.021099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1167/2372] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:18 2022] DELETE /identity/v3/projects/c0f8eb7eba734f5694d09c3478200c7c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:19.031368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.031969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.031969 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.074891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:19.076216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:19.274001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.274209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.274433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.279254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1206/2373] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:19.320883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:19.322057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:19.340776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1168/2374] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:19.345134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:19.359207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27f7f-1b3c-4ae2-b910-42ed1e4ac958 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:19.383758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:19.385186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.385544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.385826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.386538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:19.386920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:19.388562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:19.422815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1207/2375] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:19.428219 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:19.447991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588414f-67c0-4f0f-a930-774a971865f1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:19.460056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:19.460718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.461056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.461386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.462027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:19.467076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:19.560567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1169/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:19 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:19.564317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:19.597109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:19.616819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335efb42-b603-4c62-811e-ac33189d7d50 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:19.761002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:19.761862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.762011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.762278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.762939 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:19.766776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:19.820052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1208/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:19 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:19.828259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:19.889090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008728-0d22-4f8b-81c8-5b2418dead97 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:19.909487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:19.909487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.909487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.909487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.910494 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:19.921072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:19.939374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1170/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:19.963472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:19.967671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b9152-0e0e-43ef-bed0-cf34f7f5b039 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:19.976833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:19.977539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:19.977938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:19.978487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:19.979913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:19.981544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43ac95-81e9-449a-b5f9-32335df9ac86 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:20.009669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1209/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:20.015682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:20.042320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c4d8-c3ae-447e-a92c-71f0610b8ea0 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:20.049203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:20.049943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:20.050423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:20.050813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] PATH_INFO: `/v3/projects/799960ce4113407989c1a4cc951d3c32/users/08a465a3c20e49e9a9fb95e5dec2cae9/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:20.095583 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=799960ce4113407989c1a4cc951d3c32, user_id=08a465a3c20e49e9a9fb95e5dec2cae9, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:20.102639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:20.144486 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1171/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:20 2022] PUT /identity/v3/projects/799960ce4113407989c1a4cc951d3c32/users/08a465a3c20e49e9a9fb95e5dec2cae9/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:20.155398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:20.156413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:20.156912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:20.248432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] MFA Rules not processed for user `08a465a3c20e49e9a9fb95e5dec2cae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:20.253060 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:20.472894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1210/2381] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:26.128541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:26.130385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:26.216196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd541b0-138f-4778-aab8-090ac01dae4f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:26.220490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:26.221173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:26.221586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:26.221966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:26.239195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:26.239195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bc841-d0a9-45fa-bf5a-37ed49a66a6a service glance] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:26.254382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1172/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:28.403524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:28.405191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:28.663953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12e52-d50b-4a8d-880c-19cabdf979de None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:28.670824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:28.674474 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:28.674889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:28.675254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:28.678093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:28.716581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:28.718671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:28.730928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:28.741164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1211/2383] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:29.507367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb990-6156-4be1-9414-cab3abc729d4 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:29.507966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb990-6156-4be1-9414-cab3abc729d4 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:29.508311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fb990-6156-4be1-9414-cab3abc729d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:29.537441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-041fb990-6156-4be1-9414-cab3abc729d4 None None] MFA Rules not processed for user `c1e1f0b97ad54efebb8a3cb01e85a34c`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:29.538889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-041fb990-6156-4be1-9414-cab3abc729d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:29.623488 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1173/2384] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:30.058080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:30.059680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:30.145797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f90ad-08f3-40f7-8666-20bc163b4e2e service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:30.150279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:30.151005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:30.151464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:30.151819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:30.153778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:30.164597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:30.166551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:30.176618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1212/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:32.287984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:32.288520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:32.288765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:32.322076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:32.323721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:32.378444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:32.427599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1174/2386] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:20:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:32.443178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:32.444760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:32.575481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6cdd7-4bc8-4c96-b5b5-20efd79f812e service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:32.577890 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:32.578819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:32.579262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:32.579547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:32.600273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:32.604444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:32.620930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1213/2387] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:20:36.381942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:36.384426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:36.396237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccde808-122e-49af-9e20-22dd25d7f24e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:36.404924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:36.405566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:36.405849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:36.406122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:36.407884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:36.500578 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:36.501969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:36.516311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1175/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:41.348623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:41.351144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:41.375377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0143e6d-81e6-4776-bb44-cc227864a91f service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:41.381071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:41.381854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:41.382202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:41.382558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] PATH_INFO: `/v3/users/c0f3bbc3da1e49b184d357a7cc34f058` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:41.384658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f3bbc3da1e49b184d357a7cc34f058)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:41.386682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:41.450617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f3bbc3da1e49b184d357a7cc34f058'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.451596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f3bbc3da1e49b184d357a7cc34f058'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.461132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f3bbc3da1e49b184d357a7cc34f058'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.461942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f3bbc3da1e49b184d357a7cc34f058'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.471057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1f2d60c0-8a73-4f7f-acc6-3d1ab9441f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f3bbc3da1e49b184d357a7cc34f058'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.494470 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1214/2389] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:41 2022] DELETE /identity/v3/users/c0f3bbc3da1e49b184d357a7cc34f058 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:41.718429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:41.729130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae26b38-10aa-4007-8df5-5e2cddf02855 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:41.793999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:41.794637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:41.794922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:41.795228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] PATH_INFO: `/v3/projects/d584f1cf741748faa7e6c88a6419557a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:41.796375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d584f1cf741748faa7e6c88a6419557a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:41.798300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:41.849573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd584f1cf741748faa7e6c88a6419557a', 'request_id': 'req-696e739a-9aef-4f3a-8795-b60b8d1ecf63'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.857694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd584f1cf741748faa7e6c88a6419557a', 'request_id': 'req-696e739a-9aef-4f3a-8795-b60b8d1ecf63'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.864195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd584f1cf741748faa7e6c88a6419557a', 'request_id': 'req-696e739a-9aef-4f3a-8795-b60b8d1ecf63'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.875530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] The token cache is being invalidate because project d584f1cf741748faa7e6c88a6419557a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:41.875823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.876497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-696e739a-9aef-4f3a-8795-b60b8d1ecf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:41.878008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1176/2390] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:41 2022] DELETE /identity/v3/projects/d584f1cf741748faa7e6c88a6419557a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:41.883020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:41.883409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:41.883698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:41.891422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:41.906707 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:41.907995 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:41.980799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1215/2391] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:41.989910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:41.990262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:41.990455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.004345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:42.019358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:42.022474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:42.031680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1177/2392] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:42.036057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.046523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ad568-b6dd-45ef-a099-907c6928da76 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.052166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.052872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.053231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.053582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.054310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:42.054621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.056341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.070398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1216/2393] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:42.075738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.087874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7e85-f4c5-477e-bdfb-d18e85d10584 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.093224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.093848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.094120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.094395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.095077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.097031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.134766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1178/2394] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:42 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:42.139056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.150678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee32293-45f5-4e33-a7f5-bbc3e4299bc4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.209119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.209736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.210017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.210291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.210914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.213682 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.236271 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1217/2395] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:42 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:42.241235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.252706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd33a86-bdc3-44eb-91a6-31970623b7e1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.257786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.258889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.259207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.259483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.260140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.261924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.273523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1179/2396] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:42.280598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.294952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309e195-1476-4c1e-8a4e-c55881f6007c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.300081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.300696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.300981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.301256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.301903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.303600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0d4fd-2951-4d20-9486-2bd282e96cb8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.314605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1218/2397] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:42.318981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.330432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce3a7-60a7-47c1-a6f4-37ddb683d69f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.335624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.336278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.336560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.337375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] PATH_INFO: `/v3/projects/0dfbe733023f4882ab523de1344ca988/users/1ad1969d441c48d68b69b2f9f75b6e8a/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.353256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfbe733023f4882ab523de1344ca988, user_id=1ad1969d441c48d68b69b2f9f75b6e8a, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.355971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.372395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1180/2398] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:42 2022] PUT /identity/v3/projects/0dfbe733023f4882ab523de1344ca988/users/1ad1969d441c48d68b69b2f9f75b6e8a/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:42.382736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.383323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.384000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.416003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] MFA Rules not processed for user `1ad1969d441c48d68b69b2f9f75b6e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:42.417251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:42.483588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:42.490601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1219/2399] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:42.495291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.562679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed15c-147a-43df-bd5f-9bfc448e41bc admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.567456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.568069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.568353 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.568630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.569270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.571863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.611263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1181/2400] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:42 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:42.615957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.632098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966694e-e3a7-41de-8232-b98c889e9fc9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.736738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.739455 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:42.761046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.761892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.762279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.762660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.763705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.766894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.808484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1220/2401] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:42 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:42.813334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.825431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878258d-f223-4b15-8498-c40da9f55922 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.830908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.831633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.831864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.832136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.832953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.834646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.847303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1221/2402] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:42.852660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.863477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05013b3c-7246-4325-9f9d-c1039df3bb54 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.871780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531552e-fa64-4ef4-b374-ccefc4fc737a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:42.872313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.873401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.873989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.874530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] PATH_INFO: `/v3/users/08a465a3c20e49e9a9fb95e5dec2cae9` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.876636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a465a3c20e49e9a9fb95e5dec2cae9)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.877550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:42.878524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:42.878935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:42.879254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] PATH_INFO: `/v3/projects/1b1fe19b901c44ae8624d17c10144854/users/9d8614cfee4241179fa1821604df6b20/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:42.882046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.923911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1fe19b901c44ae8624d17c10144854, user_id=9d8614cfee4241179fa1821604df6b20, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:42.926758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:42.932196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:42.954042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1222/2403] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:42 2022] PUT /identity/v3/projects/1b1fe19b901c44ae8624d17c10144854/users/9d8614cfee4241179fa1821604df6b20/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:42.967201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:42.975371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a465a3c20e49e9a9fb95e5dec2cae9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:42.976274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a465a3c20e49e9a9fb95e5dec2cae9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:42.985734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a465a3c20e49e9a9fb95e5dec2cae9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:42.996514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a465a3c20e49e9a9fb95e5dec2cae9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:42.997507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2ccf9e7e-1902-4b37-84cc-b4ef89b530dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a465a3c20e49e9a9fb95e5dec2cae9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:43.026672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1182/2404] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:42 2022] DELETE /identity/v3/users/08a465a3c20e49e9a9fb95e5dec2cae9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:43.027801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.028157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.028451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.052473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:43.053180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.057727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a4bf5-851e-4c0a-9ede-a182d0a412fa admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:43.130979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1183/2405] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:43.137800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:43.138925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.139530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.140101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.141367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:43.145729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:43.146718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:43.148124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:43.150972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.170779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1223/2406] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:43.172303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:43.174952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.195532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3794db-ba44-4291-ba12-a4f77672c963 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:43.204196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:43.205392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.206111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.206273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] PATH_INFO: `/v3/projects/1b1fe19b901c44ae8624d17c10144854/users/9d8614cfee4241179fa1821604df6b20/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.209473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1fe19b901c44ae8624d17c10144854, user_id=9d8614cfee4241179fa1821604df6b20, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:43.214210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f7d13-b1bb-4193-8807-7b28f936eb04 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:43.232142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1224/2407] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:43 2022] PUT /identity/v3/projects/1b1fe19b901c44ae8624d17c10144854/users/9d8614cfee4241179fa1821604df6b20/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:43.244216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.244949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.245245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.250747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456dcd0-b621-4785-9610-87212d19f43f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:43.282318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] MFA Rules not processed for user `9d8614cfee4241179fa1821604df6b20`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:43.283957 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.332960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:43.333677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.334025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.334367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.352046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:43.397151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1225/2408] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:43.406227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:43.408628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.435985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:43.437715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8ea51-092d-4121-84e0-96e04cb654a1 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:43.450167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1184/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:43.485586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab716e5b-3ce5-4ed7-8635-a50879766739 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:43.493462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:43.494820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.495226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.495578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.507310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:43.509347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:43.522297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1226/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:43.617632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.618719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.618719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.642174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:43.643692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.736786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1185/2411] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:43.754834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:43.757193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:43.859630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eead8-dbe3-4e07-8204-825bbc864428 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:43.867868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:43.868793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:43.869174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:43.869550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:43.885592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:43.890781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:43.896395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:43.938503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1227/2412] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:20:43.964318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:43.966055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:44.007324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b341-6084-4bad-9d12-b0df94677a93 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:44.039197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:44.044636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.044843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.045189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] PATH_INFO: `/v3/projects/799960ce4113407989c1a4cc951d3c32` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.053395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=799960ce4113407989c1a4cc951d3c32)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:44.059613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:44.185373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799960ce4113407989c1a4cc951d3c32', 'request_id': 'req-c3695e5d-1344-4b17-8a20-334cd71d1f3d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.205310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799960ce4113407989c1a4cc951d3c32', 'request_id': 'req-c3695e5d-1344-4b17-8a20-334cd71d1f3d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.213720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799960ce4113407989c1a4cc951d3c32', 'request_id': 'req-c3695e5d-1344-4b17-8a20-334cd71d1f3d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.241189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:44.243458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] The token cache is being invalidate because project 799960ce4113407989c1a4cc951d3c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:44.243764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.244570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c3695e5d-1344-4b17-8a20-334cd71d1f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.248688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1186/2413] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:43 2022] DELETE /identity/v3/projects/799960ce4113407989c1a4cc951d3c32 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:44.253360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8af280-56e0-4d09-901c-cea1e3b36594 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.253874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8af280-56e0-4d09-901c-cea1e3b36594 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.254352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8af280-56e0-4d09-901c-cea1e3b36594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.273596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2222cc3-4f92-4117-8120-1fe71200b4b2 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:44.341306 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6b8af280-56e0-4d09-901c-cea1e3b36594 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:44.342888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6b8af280-56e0-4d09-901c-cea1e3b36594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:44.426417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:44.449190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:44.451019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.454942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.455964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] PATH_INFO: `/v3/users/1ad1969d441c48d68b69b2f9f75b6e8a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.458253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad1969d441c48d68b69b2f9f75b6e8a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:44.468914 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:44.525459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1187/2414] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:44.533658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.533946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.534234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.589076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:44.590041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad1969d441c48d68b69b2f9f75b6e8a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.590392 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:44.591296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad1969d441c48d68b69b2f9f75b6e8a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.614679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1188/2415] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:44.620755 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:44.621291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad1969d441c48d68b69b2f9f75b6e8a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.622613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad1969d441c48d68b69b2f9f75b6e8a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.644868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-361020a0-2f33-42a4-a564-1b6b8e8aa5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad1969d441c48d68b69b2f9f75b6e8a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:44.649896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382e01a-8d33-44c9-9d52-4a6065269c2b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:44.746665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1228/2416] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:44 2022] DELETE /identity/v3/users/1ad1969d441c48d68b69b2f9f75b6e8a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:44.753756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.754358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.754748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.776395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:44.778218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:44.780652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:44.781463 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:44.782914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:44.787005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:44.788939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:44.826620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:44.827310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1189/2417] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:44.828952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:44.832479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:44.835421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:44.857490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354f06f-32ce-4f99-8648-505c1ee13725 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:44.999776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1229/2418] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:45.005634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.006270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.006553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.006831 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.007527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.010208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.013827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.016307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:45.046481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:45.081380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1190/2419] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:44 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:45.084330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.126345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668053-f71d-4d14-be41-ccb85d615d34 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:45.233571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066578f-f2f3-44c0-a045-584e5e333cdc admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:45.241622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.242355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.242524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.243493 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.243656 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.243886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.244093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.244353 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.245023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.247650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.276573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.278023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.293226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1191/2420] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:45 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:45.298062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.319484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1230/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:45.326454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916b532-0207-491a-b9ed-6ad5a93e55fb admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:45.335304 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.336055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.336688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.337044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.337783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.339712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.353479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1192/2422] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:45.359560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.372685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51ca76-5b43-49c1-82ae-135c9a4e07fc service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:45.378613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.379531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.379883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.380274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.381017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.383045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16ea5-70f4-4bfc-b712-22629d973467 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.397134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1231/2423] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:45.404417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.418177 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7536cf-b1f6-4abc-ba40-74f21caee9c6 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:45.429310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:45.430462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.430749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.431248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] PATH_INFO: `/v3/projects/47f2a6cc35284febb3a9e87d8a26288f/users/2530fd5444f048cb92a6585a1a3d867a/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.458610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f2a6cc35284febb3a9e87d8a26288f, user_id=2530fd5444f048cb92a6585a1a3d867a, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:45.462734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:45.478852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:45.489365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1193/2424] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:45 2022] PUT /identity/v3/projects/47f2a6cc35284febb3a9e87d8a26288f/users/2530fd5444f048cb92a6585a1a3d867a/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:45.503207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:45.503207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:45.503207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:45.565651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] MFA Rules not processed for user `2530fd5444f048cb92a6585a1a3d867a`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:45.567518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:45.857605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1232/2425] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:45.862610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.994317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:45.996450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:46.054765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f03b0-0f2f-4f0b-b76e-bcc0c881e1ca admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.061019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.061659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.061940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.062460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.064118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.066521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.127379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:46.130313 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e654d9-c0f3-4127-a01c-fa934f0afcbc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.131882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1194/2426] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:46.137731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.235907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.236570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.238574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.238574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] PATH_INFO: `/v3/projects/0dfbe733023f4882ab523de1344ca988` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.239838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfbe733023f4882ab523de1344ca988)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.241815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.290685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a3d9b-f596-4bb5-a316-82fc810469ca admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.296632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.297371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.297649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.298019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.298633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.301592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.325871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1195/2427] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:46 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:46.331201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.331463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfbe733023f4882ab523de1344ca988', 'request_id': 'req-9f11149c-2357-40c8-85b1-9bfd6fb57c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.339632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfbe733023f4882ab523de1344ca988', 'request_id': 'req-9f11149c-2357-40c8-85b1-9bfd6fb57c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.342575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9a706-6bf7-4210-9318-844e508521e1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.351488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfbe733023f4882ab523de1344ca988', 'request_id': 'req-9f11149c-2357-40c8-85b1-9bfd6fb57c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.366502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] The token cache is being invalidate because project 0dfbe733023f4882ab523de1344ca988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:46.366791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.367505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.369883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1233/2428] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:45 2022] DELETE /identity/v3/projects/0dfbe733023f4882ab523de1344ca988 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:46.375220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.377797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:46.414031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.414679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.414964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.415255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.415902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.417691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.431237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1196/2429] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:46.435223 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.436960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:46.450262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a510b9-1122-4276-ab72-af41dd7d0742 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.451780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11149c-2357-40c8-85b1-9bfd6fb57c35 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.456762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.457388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.457670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.457945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.458221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.458649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.459022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.459944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.460216 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] PATH_INFO: `/v3/users/9d8614cfee4241179fa1821604df6b20` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.460332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.461593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d8614cfee4241179fa1821604df6b20)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.463049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:46.464068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.480376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1197/2430] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:46.482903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.494197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021000af-b9d4-4784-b804-3cfcee280dab admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.501037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.501777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.502067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.502363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] PATH_INFO: `/v3/projects/680350729eb54641ba7ade7412672ed3/users/5d4b98f445b74054b0f0377ec1823d00/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.517950 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:46.521613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=680350729eb54641ba7ade7412672ed3, user_id=5d4b98f445b74054b0f0377ec1823d00, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.524794 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c1ec7-5566-4b41-9189-c0d8dc47ad0c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.530514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d8614cfee4241179fa1821604df6b20'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.531429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d8614cfee4241179fa1821604df6b20'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.540100 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1198/2431] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:46 2022] PUT /identity/v3/projects/680350729eb54641ba7ade7412672ed3/users/5d4b98f445b74054b0f0377ec1823d00/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:46.542398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d8614cfee4241179fa1821604df6b20'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.543057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d8614cfee4241179fa1821604df6b20'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.553253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.553545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.553827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.556447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d8614cfee4241179fa1821604df6b20'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:46.590477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1234/2432] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:46 2022] DELETE /identity/v3/users/9d8614cfee4241179fa1821604df6b20 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:46.591753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] MFA Rules not processed for user `5d4b98f445b74054b0f0377ec1823d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:46.592981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:46.678424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1199/2433] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:46.684643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.686505 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:46.801175 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69c4e-5944-42a0-818f-7b134dfc9941 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:46.812327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:46.813254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:46.814759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:46.815110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:46.815567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:46.817641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:46.862651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1235/2434] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:46 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:20:46.864059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:46.877761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232d23e-2cf9-4fac-a468-53da529ace5e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.004168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.010396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:47.017287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.018288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.018790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.019546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.021317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.034857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.046226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1c76-312e-4af1-a2bc-37f3187539d3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.061256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.062380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.065103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.065691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] PATH_INFO: `/v3/projects/1b1fe19b901c44ae8624d17c10144854` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.069163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1fe19b901c44ae8624d17c10144854)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.073698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.088913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1200/2435] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:46 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:47.098259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.125990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5650-2c9d-4961-b41a-3f61d6d1ea5a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.134153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.134841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.135079 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.135593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.136482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.138305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.166885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1201/2436] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:47.173732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.199662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad3a27-304a-440a-ae85-6d5bee83cc0f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.207028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1fe19b901c44ae8624d17c10144854', 'request_id': 'req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:47.222034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1fe19b901c44ae8624d17c10144854', 'request_id': 'req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:47.238446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1fe19b901c44ae8624d17c10144854', 'request_id': 'req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:47.263263 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] The token cache is being invalidate because project 1b1fe19b901c44ae8624d17c10144854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:47.263559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:47.264719 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-63b130db-a4fb-47ca-9d53-fbcdb854fdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:47.270772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1236/2437] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:47 2022] DELETE /identity/v3/projects/1b1fe19b901c44ae8624d17c10144854 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:47.273228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e122-5f9f-4aed-84b3-1a2c15b0dd41 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.273710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e122-5f9f-4aed-84b3-1a2c15b0dd41 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.279262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21e122-5f9f-4aed-84b3-1a2c15b0dd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.281516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:47.307457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2b21e122-5f9f-4aed-84b3-1a2c15b0dd41 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:47.308727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2b21e122-5f9f-4aed-84b3-1a2c15b0dd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:47.309077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.310143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.310538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.310910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] PATH_INFO: `/v3/projects/5217c322206e4fe9b213de25fdb565c1/users/e5601929ade84d5b83bbd8b1b6643d52/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.324148 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1237/2438] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:47.325789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.326116 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.326385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.355377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5217c322206e4fe9b213de25fdb565c1, user_id=e5601929ade84d5b83bbd8b1b6643d52, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.358482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.365775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:47.367948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:47.385429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1202/2439] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:47 2022] PUT /identity/v3/projects/5217c322206e4fe9b213de25fdb565c1/users/e5601929ade84d5b83bbd8b1b6643d52/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:47.388357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1238/2440] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:47.390038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.395022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.401144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:47.409105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d8234-17a3-4068-8fb9-de14f5d07ab4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.421558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:47.552425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.553207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.553611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.553981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.556751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:47.568354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.576929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.595374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92928-0fcd-423a-a041-a1170c7d79a4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.603658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.604530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.605092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.605524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.606579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.607540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1239/2441] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:47.609791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.611589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.631742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dda38-4304-4a76-a55b-cbaecdf17ce5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.635890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1203/2442] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:47.650805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.651520 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.651805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.652078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.652731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.654853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.659538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.673004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff3f39-610e-4fd8-ac37-53fa8db5cd57 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.682179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.683693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.684277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.684979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] PATH_INFO: `/v3/projects/5217c322206e4fe9b213de25fdb565c1/users/e5601929ade84d5b83bbd8b1b6643d52/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.689634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5217c322206e4fe9b213de25fdb565c1, user_id=e5601929ade84d5b83bbd8b1b6643d52, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.695587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f38b78-4e4c-44b5-a60c-2cb5a510bae7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.710541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1240/2443] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:47 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:20:47.712732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1204/2444] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:47 2022] PUT /identity/v3/projects/5217c322206e4fe9b213de25fdb565c1/users/e5601929ade84d5b83bbd8b1b6643d52/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:47.716099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.726052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.730282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.730961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.831937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] MFA Rules not processed for user `e5601929ade84d5b83bbd8b1b6643d52`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:47.835308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:47.873713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f6e171-28d5-428e-ad4e-d15e8db5e85b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.885494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.886186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.886536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.886815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.887482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.891915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.936931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1241/2445] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:47 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:47.938212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:47.952511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d12d-4063-46e0-9780-c94e5cf512c2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:47.960852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:47.962332 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:47.962722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:47.963128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:47.963740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:47.967198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:47.996785 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1242/2446] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:47.999232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.016663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1205/2447] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:48.021408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88309d1e-0c31-4ddf-b0c4-1ca8b02d0fa0 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.026041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.028452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:48.033822 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.034793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.035249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.035546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.036187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.037916 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.065468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1243/2448] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:48.067390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.088210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b5be56-6312-48db-afcd-f250c47508db admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.095319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.096742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.097011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.097289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] PATH_INFO: `/v3/projects/d364358688e8496dbcc538e742f76cb9/users/2784f05a4655435a86ddecc8865204ee/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.116771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:48.125584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d364358688e8496dbcc538e742f76cb9, user_id=2784f05a4655435a86ddecc8865204ee, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.130222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8389e-2452-48fe-9f4e-d10facdb7feb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.160311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1244/2449] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:48 2022] PUT /identity/v3/projects/d364358688e8496dbcc538e742f76cb9/users/2784f05a4655435a86ddecc8865204ee/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:48.171186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766893a7-7672-455b-8fc1-f54aa3dd51b9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.173962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.174243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.174514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.221356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] MFA Rules not processed for user `2784f05a4655435a86ddecc8865204ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:48.222954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:48.257252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:48.273390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.274179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.274565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.274945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.294012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:48.362768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1245/2450] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:48.367653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.427672 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.428864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.441278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1206/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:48.548075 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0a4c-fe1c-40a9-974e-e42a0a21885b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.566508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.567395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.567514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.567717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.569023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.572199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.640391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1246/2452] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:48 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:48.641890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.663190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aad948-ff57-4da0-affc-cd0fa074d312 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.787565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.788289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.788611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.788901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.789968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.792714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.828993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1207/2453] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:48 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:48.832990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.852747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717160c4-2885-48ad-abe8-608e0753da15 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.861800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.873973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.876892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.877510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.889427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.892799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:48.918097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1247/2454] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:48.923127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:48.946770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becea582-6f22-451f-b0fb-e330a3e6b0e3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:48.952091 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:48.953112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:48.953801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:48.954257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] PATH_INFO: `/v3/projects/65095a39d138495d9989bd8341938b02/users/7b66ad8d70b043d799662b19d6374dcb/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:48.987763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65095a39d138495d9989bd8341938b02, user_id=7b66ad8d70b043d799662b19d6374dcb, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:48.990643 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:49.059705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1208/2455] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:48 2022] PUT /identity/v3/projects/65095a39d138495d9989bd8341938b02/users/7b66ad8d70b043d799662b19d6374dcb/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:49.061919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:49.085082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05612c38-2be0-49a3-91e4-d0a2d0fa196a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:49.247679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:49.248297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:49.248575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:49.248847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:49.249488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:49.251120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306c40c-d2f1-44c6-98f6-fa4ae7011fa8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:49.267183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1248/2456] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:49.268753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:49.296937 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3da51-0c18-466e-9a00-92f416e2143a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:49.302107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:49.302783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:49.303059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:49.303376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] PATH_INFO: `/v3/projects/65095a39d138495d9989bd8341938b02/users/7b66ad8d70b043d799662b19d6374dcb/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:49.306019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65095a39d138495d9989bd8341938b02, user_id=7b66ad8d70b043d799662b19d6374dcb, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:49.309215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:49.312945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:49.325726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1209/2457] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:49 2022] PUT /identity/v3/projects/65095a39d138495d9989bd8341938b02/users/7b66ad8d70b043d799662b19d6374dcb/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:49.338222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:49.338515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:49.338818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:49.376050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] MFA Rules not processed for user `7b66ad8d70b043d799662b19d6374dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:49.377653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:49.399581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:49.490372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1249/2458] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:49.504827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:49.588976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3ca4f-7547-4904-bad9-0d6df4847b16 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:49.594599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:49.595588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:49.596083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:49.596547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:49.608589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:49.610397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:49.625366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1210/2459] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:49.881808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:49.887479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.038913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e780402-1e48-4f26-9495-7b257b62d700 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:50.062292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:50.063337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:50.063720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:50.064053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:50.065987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.082562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:50.084410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:50.110488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1250/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:50.214735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:50.355377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d539-10c7-44d5-bfa8-d8cf425e8840 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:50.370950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:50.371902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:50.372332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:50.373185 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] PATH_INFO: `/v3/users/2784f05a4655435a86ddecc8865204ee` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:50.374511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2784f05a4655435a86ddecc8865204ee)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:50.376998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:50.474132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2784f05a4655435a86ddecc8865204ee'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:50.474900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2784f05a4655435a86ddecc8865204ee'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:50.486174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2784f05a4655435a86ddecc8865204ee'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:50.497932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2784f05a4655435a86ddecc8865204ee'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:50.497932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c240054e-f1f1-4764-b4a8-a348240a6b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2784f05a4655435a86ddecc8865204ee'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:50.515976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:50.521420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1211/2461] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:50 2022] DELETE /identity/v3/users/2784f05a4655435a86ddecc8865204ee => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:50.526074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:50.526440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:50.526825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:50.528347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.554861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79a8f-8e7f-4601-99c0-fc7a6d264af0 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:50.565956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:50.567695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.591329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:50.631668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:50.632851 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:50.633409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:50.633753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:50.636383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.673538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1212/2462] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:50.695745 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:50.701225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:50.735480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:50.748388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:50.749909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:50.760345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1251/2463] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:50.772820 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde38f27-9809-4c6a-bde4-ca78ae39d339 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:50.784842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:50.785910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:50.786725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:50.787190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:50.799704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:50.802941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:50.833136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1213/2464] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:51.199910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:51.201418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:51.229610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0584b-884f-45b3-9d2e-7a9e1e29c749 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:51.236117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:51.237195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:51.238284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:51.238669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] PATH_INFO: `/v3/projects/d364358688e8496dbcc538e742f76cb9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:51.244673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d364358688e8496dbcc538e742f76cb9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:51.247246 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:51.311350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd364358688e8496dbcc538e742f76cb9', 'request_id': 'req-8acf1d35-600b-48e0-bc3c-449248e008e3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.319983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd364358688e8496dbcc538e742f76cb9', 'request_id': 'req-8acf1d35-600b-48e0-bc3c-449248e008e3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.332968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd364358688e8496dbcc538e742f76cb9', 'request_id': 'req-8acf1d35-600b-48e0-bc3c-449248e008e3'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.364344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] The token cache is being invalidate because project d364358688e8496dbcc538e742f76cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:51.364773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.365640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.370619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1252/2465] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:51 2022] DELETE /identity/v3/projects/d364358688e8496dbcc538e742f76cb9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:51.372394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:51.409763 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb78fcd-0867-4927-ae81-3a63f8f15eb9 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:51.687808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:51.689397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:51.689973 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:51.690410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] PATH_INFO: `/v3/users/7b66ad8d70b043d799662b19d6374dcb` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:51.692218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b66ad8d70b043d799662b19d6374dcb)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:51.694695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:51.752282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:51.755386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:51.864838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b66ad8d70b043d799662b19d6374dcb'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.865649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b66ad8d70b043d799662b19d6374dcb'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.878754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b66ad8d70b043d799662b19d6374dcb'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.897073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b66ad8d70b043d799662b19d6374dcb'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.898139 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b66ad8d70b043d799662b19d6374dcb'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:51.903394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:51.934518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf1d35-600b-48e0-bc3c-449248e008e3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:51.939482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:51.940547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:51.940988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:51.941276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:51.943956 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:51.948812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1214/2466] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:51 2022] DELETE /identity/v3/users/7b66ad8d70b043d799662b19d6374dcb => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:52.075915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:52.077352 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c513d4-adf8-414b-aa04-5c37cb81e719 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:52.112465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1253/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:52.497849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:52.499436 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:52.625853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f501b54-c26b-40f4-b598-aac82e9e2b61 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:52.633603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:52.634428 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:52.634715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:52.635140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] PATH_INFO: `/v3/projects/65095a39d138495d9989bd8341938b02` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:52.636586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=65095a39d138495d9989bd8341938b02)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:52.638567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:52.698675 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65095a39d138495d9989bd8341938b02', 'request_id': 'req-902caec3-cb3f-4ec7-bd73-7d16977210ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:52.709213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65095a39d138495d9989bd8341938b02', 'request_id': 'req-902caec3-cb3f-4ec7-bd73-7d16977210ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:52.720061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65095a39d138495d9989bd8341938b02', 'request_id': 'req-902caec3-cb3f-4ec7-bd73-7d16977210ae'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:52.733931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] The token cache is being invalidate because project 65095a39d138495d9989bd8341938b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:52.734220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:52.734883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-902caec3-cb3f-4ec7-bd73-7d16977210ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:52.736479 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1215/2468] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:52 2022] DELETE /identity/v3/projects/65095a39d138495d9989bd8341938b02 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:52.741679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:52.742201 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:52.742300 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:52.779240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:52.780483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:52.804185 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:52.875356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1254/2469] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:52.877092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:52.877380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:52.877683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:52.929358 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:52.931766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:52.968761 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1216/2470] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:52.970145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:52.980700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201c571-e7a5-4a4e-bd88-aa81cee8a3b1 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:52.998676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:52.999334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:52.999622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:52.999907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.000552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:53.000889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.002535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.033115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1255/2471] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:53.037638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.052530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25300ee-ba5c-4351-b320-ea231543cd61 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.059982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.060928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.061441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.062189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.063143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.065741 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.107807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1217/2472] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:53 2022] POST /identity/v3/projects => generated 359 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:20:53.115118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.132168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0737c-a93d-4416-a8d9-03d875fa6218 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.214028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.214717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.215108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.215502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.216227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.218385 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.253062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1256/2473] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:53 2022] POST /identity/v3/users => generated 280 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:53.260605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.299590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccd95-1bd8-4c65-944a-74b8f9d128d3 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.305732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.307143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.307690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.308179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.309060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.311406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.323199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1218/2474] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:53.327307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.339226 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0c73-4081-4359-a59a-5c17bf3b4c3f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.344559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.345172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.345454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.345729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.346377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.348052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe9a9e-d978-4629-bfc1-692137320a18 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.363097 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1257/2475] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:53.365607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.378246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cae34e-7904-4bd5-aeba-36d8a451c20b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.384490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.385178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.385462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.385742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] PATH_INFO: `/v3/projects/624368588f044eec92c97faa7dde5f16/users/6e321daa5371411e927dc9a216958b88/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.403642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] RBAC: Authorizing `identity:create_grant(project_id=624368588f044eec92c97faa7dde5f16, user_id=6e321daa5371411e927dc9a216958b88, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.406572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.426127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1219/2476] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:53 2022] PUT /identity/v3/projects/624368588f044eec92c97faa7dde5f16/users/6e321daa5371411e927dc9a216958b88/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:53.437301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.437807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.438194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.496771 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] MFA Rules not processed for user `6e321daa5371411e927dc9a216958b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:53.498542 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:53.587195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1258/2477] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:53.627482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.629767 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:53.640519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:53.713348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db3ac-d384-437d-bd2f-670e13c0552e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.717768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.718552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.718899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.719251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.737212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.739042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e2587-6899-4c99-96c5-5ddf1898f052 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.750683 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1220/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:53.766700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:53.788976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:53.835110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ad26-9ed6-4cd2-b20f-d15c57091e70 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:53.840593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:53.841210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.841508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.841764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] PATH_INFO: `/v3/users/6e321daa5371411e927dc9a216958b88` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.842973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e321daa5371411e927dc9a216958b88)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:53.844944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:53.894225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e321daa5371411e927dc9a216958b88'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:53.894925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e321daa5371411e927dc9a216958b88'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:53.905635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e321daa5371411e927dc9a216958b88'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:53.906294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e321daa5371411e927dc9a216958b88'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:53.919247 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e321daa5371411e927dc9a216958b88'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:53.945244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1259/2479] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:53 2022] DELETE /identity/v3/users/6e321daa5371411e927dc9a216958b88 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:53.947363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:53.947648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:53.948046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:53.968609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:53.969732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:54.038092 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1221/2480] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:54.048206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.049738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:54.122150 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c6cdf-e2eb-4734-a671-f5bb72cfa0ce admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.126172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.126794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.127070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.127380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.140624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.142135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c16a2-8765-4d8c-9934-642eb22ec1a8 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.153500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1260/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:54.468232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.469897 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:54.486156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf6193-d282-414f-b841-b533093e63a5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.491632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.492190 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.492980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.493382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] PATH_INFO: `/v3/projects/624368588f044eec92c97faa7dde5f16` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.494816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=624368588f044eec92c97faa7dde5f16)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.496785 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.550132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624368588f044eec92c97faa7dde5f16', 'request_id': 'req-cdab65dc-8b33-46ae-abc2-95310a0adaab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:54.558859 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624368588f044eec92c97faa7dde5f16', 'request_id': 'req-cdab65dc-8b33-46ae-abc2-95310a0adaab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:54.564935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624368588f044eec92c97faa7dde5f16', 'request_id': 'req-cdab65dc-8b33-46ae-abc2-95310a0adaab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:54.577407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] The token cache is being invalidate because project 624368588f044eec92c97faa7dde5f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:54.577733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:54.578426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-cdab65dc-8b33-46ae-abc2-95310a0adaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:54.580268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1222/2482] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:54 2022] DELETE /identity/v3/projects/624368588f044eec92c97faa7dde5f16 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:54.585846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.586229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.586690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.606688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:54.607935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:54.643838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:54.672530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1261/2483] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:54.682038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.682577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.682720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.705202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:54.706439 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:54.714599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1223/2484] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:54.719359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.729780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab9e9-570c-4ad0-bc8b-4883b6da8811 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.734499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.735102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.735483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.735755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.736402 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:54.736718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.738349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.752023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1262/2485] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:54.756339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.767681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03c8c8-1314-4773-9dcb-2f2f91ab1784 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.772714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.773361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.773746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.774135 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.775068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.777055 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.807917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1224/2486] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:54 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:54.812037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.822912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75796c-f14c-423a-a175-84aa12a3cead admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.886260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.886946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.887500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.887615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.888224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.890412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.917632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1263/2487] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:54 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:54.923606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.931507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:54.939088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9b899-c337-44c7-b3df-461074c8368f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.947261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.948317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.948636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.948907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.949632 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.951381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:54.968320 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1225/2488] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:54.973239 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:54.984791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ceaebd-0717-4780-9227-e4d6a41aee27 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:54.990315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:54.991092 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:54.991421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:54.991738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:54.992464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:54.996124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef87298-f982-4a65-9126-ef2b8d18c6f1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:55.009277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1264/2489] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:55.013810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:55.027270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6239d-7c38-44b2-b0a7-ad0863c07791 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:55.032213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:55.032880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:55.033161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:55.033433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] PATH_INFO: `/v3/projects/56333522598f43fd8968f11c79a46ebc/users/2f59b2ec2b584a20b912e7d40a2fb837/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:55.053538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56333522598f43fd8968f11c79a46ebc, user_id=2f59b2ec2b584a20b912e7d40a2fb837, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:55.056878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:55.072156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1226/2490] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:55 2022] PUT /identity/v3/projects/56333522598f43fd8968f11c79a46ebc/users/2f59b2ec2b584a20b912e7d40a2fb837/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:55.082368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:55.082680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:55.082932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:55.120551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] MFA Rules not processed for user `2f59b2ec2b584a20b912e7d40a2fb837`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:55.121932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:55.219492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1265/2491] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:55.233877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:55.235553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:55.323823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498ef0d-49b6-4d54-8b24-5852e360b6cd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:55.327716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:55.328331 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:55.328882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:55.329163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:55.340607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:55.342273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266a98c-be81-4862-bd71-6deab3a67522 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:55.355339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1227/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:20:56.306523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:56.308183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:56.350267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:56.386142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa71380-fdb9-4321-a713-c80069eca94b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:56.393980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:56.394837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:56.394990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:56.395203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] PATH_INFO: `/v3/users/2530fd5444f048cb92a6585a1a3d867a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:56.396449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2530fd5444f048cb92a6585a1a3d867a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:56.398589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:56.448117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2530fd5444f048cb92a6585a1a3d867a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:56.448779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2530fd5444f048cb92a6585a1a3d867a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:56.457004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2530fd5444f048cb92a6585a1a3d867a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:56.457720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2530fd5444f048cb92a6585a1a3d867a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:56.465740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2530fd5444f048cb92a6585a1a3d867a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:56.489964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1266/2493] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:56 2022] DELETE /identity/v3/users/2530fd5444f048cb92a6585a1a3d867a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:56.495333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:56.495889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:56.495889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:56.516656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:56.517856 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:56.590911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1228/2494] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:56.603424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:56.604930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:56.671896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aac0-263d-4685-bd24-d0b0afd6b816 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:56.675725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:56.676441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:56.676730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:56.677008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:56.688159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:56.689634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:56.701113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1267/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:20:57.088860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:57.090914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:57.103950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccf90-a366-4e58-9a97-2fd070cf5990 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:57.109409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:57.110119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:57.110401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:57.110875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] PATH_INFO: `/v3/projects/47f2a6cc35284febb3a9e87d8a26288f` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:57.113191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f2a6cc35284febb3a9e87d8a26288f)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:57.115844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:57.178910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f2a6cc35284febb3a9e87d8a26288f', 'request_id': 'req-efa38ea7-6351-4afc-aac6-779bfd6f275e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.188053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f2a6cc35284febb3a9e87d8a26288f', 'request_id': 'req-efa38ea7-6351-4afc-aac6-779bfd6f275e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.194111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f2a6cc35284febb3a9e87d8a26288f', 'request_id': 'req-efa38ea7-6351-4afc-aac6-779bfd6f275e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.197061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:57.210103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] The token cache is being invalidate because project 47f2a6cc35284febb3a9e87d8a26288f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:57.210400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.211742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.213434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1229/2496] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:57 2022] DELETE /identity/v3/projects/47f2a6cc35284febb3a9e87d8a26288f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:57.217517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:57.228213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63444c-fa9f-4756-a4ba-e8bf1650693f service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:57.286660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:57.294876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:57.295833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:57.296499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:57.296866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] PATH_INFO: `/v3/users/5d4b98f445b74054b0f0377ec1823d00` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:57.298235 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4b98f445b74054b0f0377ec1823d00)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:57.300738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:57.354153 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4b98f445b74054b0f0377ec1823d00'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.354893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4b98f445b74054b0f0377ec1823d00'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.363466 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4b98f445b74054b0f0377ec1823d00'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.364128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4b98f445b74054b0f0377ec1823d00'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.372164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4b98f445b74054b0f0377ec1823d00'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.391455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1268/2497] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:57 2022] DELETE /identity/v3/users/5d4b98f445b74054b0f0377ec1823d00 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:20:57.692401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:57.694262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:57.718037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38ea7-6351-4afc-aac6-779bfd6f275e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:57.795200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:57.795968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:57.796504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:57.796650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] PATH_INFO: `/v3/projects/680350729eb54641ba7ade7412672ed3` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:57.798360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680350729eb54641ba7ade7412672ed3)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:57.800426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:57.866949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680350729eb54641ba7ade7412672ed3', 'request_id': 'req-de25ffe0-6908-430e-b3cd-8af8335af5f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.878595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680350729eb54641ba7ade7412672ed3', 'request_id': 'req-de25ffe0-6908-430e-b3cd-8af8335af5f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.888517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680350729eb54641ba7ade7412672ed3', 'request_id': 'req-de25ffe0-6908-430e-b3cd-8af8335af5f4'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.904489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] The token cache is being invalidate because project 680350729eb54641ba7ade7412672ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:57.904804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.905588 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:57.910642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1230/2498] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:57 2022] DELETE /identity/v3/projects/680350729eb54641ba7ade7412672ed3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:57.913022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:57.916715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:57.940003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa94b3a-07cd-4e0c-ae28-d168ad5b53c3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:58.025536 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:58.026223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:58.026502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:58.027381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] PATH_INFO: `/v3/users/e5601929ade84d5b83bbd8b1b6643d52` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:58.028378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5601929ade84d5b83bbd8b1b6643d52)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:58.030355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:58.112231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5601929ade84d5b83bbd8b1b6643d52'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.117960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5601929ade84d5b83bbd8b1b6643d52'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.129199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5601929ade84d5b83bbd8b1b6643d52'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.134350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5601929ade84d5b83bbd8b1b6643d52'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.162272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-61c5c6cb-a12d-4c57-a84a-2a95f2c2d7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5601929ade84d5b83bbd8b1b6643d52'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.174915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:58.194295 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1269/2499] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:20:57 2022] DELETE /identity/v3/users/e5601929ade84d5b83bbd8b1b6643d52 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:58.754327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:58.756986 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:58.771993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25ffe0-6908-430e-b3cd-8af8335af5f4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:58.844317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:58.845031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:58.845241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:58.845516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] PATH_INFO: `/v3/projects/5217c322206e4fe9b213de25fdb565c1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:58.847900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5217c322206e4fe9b213de25fdb565c1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:58.849841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:58.885908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:58.908752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5217c322206e4fe9b213de25fdb565c1', 'request_id': 'req-3460e102-a2f7-4c0a-afb7-15640300b796'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.918954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5217c322206e4fe9b213de25fdb565c1', 'request_id': 'req-3460e102-a2f7-4c0a-afb7-15640300b796'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.927821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5217c322206e4fe9b213de25fdb565c1', 'request_id': 'req-3460e102-a2f7-4c0a-afb7-15640300b796'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.940852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] The token cache is being invalidate because project 5217c322206e4fe9b213de25fdb565c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:20:58.941150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.941826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3460e102-a2f7-4c0a-afb7-15640300b796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:20:58.943642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1231/2500] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:20:58 2022] DELETE /identity/v3/projects/5217c322206e4fe9b213de25fdb565c1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:58.948977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:58.949630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:58.949630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:58.971022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:58.972382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.050613 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1270/2501] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:59.060861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.061151 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.061446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.090066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:59.091368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.100821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1232/2502] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:59.105578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.116361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90bba2-cf35-41fb-a338-ac4bc4fea8af None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.121511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.122194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.122481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.122752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.123433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:20:59.123738 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.125356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.138566 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1271/2503] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:20:59.143809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.153348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e5b5f-cfc6-493c-95b9-9173eb342ad9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.158042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.158668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.158942 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.159246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.159871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.161780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.191457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1233/2504] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:20:59 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:59.196710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.208399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffa64e-b661-4006-9849-97dc100e8507 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.266911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.267553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.267833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.268103 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.268724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.270647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f56c5b-03bc-4f6b-a932-4eff4517dd4e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.293755 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1272/2505] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:20:59 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:20:59.297977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.311715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecb0d3-1e19-48d4-b081-1f661659c14b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.324060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.324970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.325253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.325522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.326178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.327969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.342514 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1234/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:20:59.343932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.347389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222be7-960f-4d5b-b20a-5685dd2794b0 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.347835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222be7-960f-4d5b-b20a-5685dd2794b0 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.348213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04222be7-960f-4d5b-b20a-5685dd2794b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.355746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34b3b9-ea3b-4f76-a306-5b1e633b4e11 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.360639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.361194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.361472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.361743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.362376 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.364006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.373864 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-04222be7-960f-4d5b-b20a-5685dd2794b0 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:59.375254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-04222be7-960f-4d5b-b20a-5685dd2794b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.378786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1235/2507] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:20:59.380710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.393084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4e0c-9f6f-4aa6-80fe-f78a10e57cc5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.404864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.405768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.406362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.407238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] PATH_INFO: `/v3/projects/4c5a5d1cf1ac4cf4a5886a77a823001a/users/c8718a4f73e0419cb0b2e7d3e4600646/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.436892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5a5d1cf1ac4cf4a5886a77a823001a, user_id=c8718a4f73e0419cb0b2e7d3e4600646, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.440758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.463440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1236/2508] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:20:59 2022] PUT /identity/v3/projects/4c5a5d1cf1ac4cf4a5886a77a823001a/users/c8718a4f73e0419cb0b2e7d3e4600646/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:20:59.463737 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1273/2509] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:20:59.481930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.485156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.532503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.532796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.533114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.579577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229f4a8-7e21-468a-b613-6e6272cd95be admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.582370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] MFA Rules not processed for user `c8718a4f73e0419cb0b2e7d3e4600646`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:20:59.583740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.585538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.586291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.586571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.586844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.590104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:59.637934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:20:59.663903 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.666094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.667875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1274/2510] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:20:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:20:59.675775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1237/2511] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:20:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:20:59.679564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:20:59.681584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:20:59.771598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad9852-71c3-4fb0-aab0-409073df8114 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:20:59.776960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:20:59.777509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:20:59.777798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:20:59.778176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:20:59.791028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:20:59.792617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:20:59.811397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1275/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:20:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:21:03.418214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:03.420056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:03.498874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c21f-7cee-4332-a66b-e7107168babc service swift] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:03.502972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:03.503649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:03.504004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:03.504350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:03.506197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:03.578009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:03.579777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:03.591325 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1238/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:21:04.129651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:04.139054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fa967-0cf8-41c4-8b8f-dacfbf5e6523 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:04.142981 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:04.143610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:04.143886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:04.144156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:04.146080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:04.268194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:04.268194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:04.275323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1276/2514] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:05.581553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:05.583144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:05.731813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430c8d2-6865-49e4-bea7-4dbb4f20a74b service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:05.747574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:05.748517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:05.748940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:05.749406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:05.753373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:05.784288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:05.788090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b29fa7-6d65-41ee-969c-e7ea9d4e4c7c service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:05.802736 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1239/2515] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:07.753902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:07.755837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:07.845296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:07.868348 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e1046-ed50-4e4d-9fc3-2f086e4cad3d service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:07.873517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:07.874253 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:07.874605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:07.874949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] PATH_INFO: `/v3/users/2f59b2ec2b584a20b912e7d40a2fb837` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:07.876314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f59b2ec2b584a20b912e7d40a2fb837)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:07.879241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:07.948930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f59b2ec2b584a20b912e7d40a2fb837'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:07.949726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f59b2ec2b584a20b912e7d40a2fb837'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:07.964319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f59b2ec2b584a20b912e7d40a2fb837'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:07.964874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f59b2ec2b584a20b912e7d40a2fb837'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:07.979848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f59b2ec2b584a20b912e7d40a2fb837'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.022401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1277/2516] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:07 2022] DELETE /identity/v3/users/2f59b2ec2b584a20b912e7d40a2fb837 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:08.027066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.027911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.030957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.067784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:08.069284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:08.090916 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:08.203327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1240/2517] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:08.211544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:08.213198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:08.301746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00decc66-5f38-443e-85b9-583930fb79fe admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:08.307410 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:08.308652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.308652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.309228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.321539 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:08.323230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e500a-048c-420d-84b8-b9b0612a798d service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:08.336119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1278/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:08.671679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:08.673052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:08.688059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb28ada-7585-46d3-8e58-49567725ef90 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:08.693826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:08.694848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.695659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.696095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] PATH_INFO: `/v3/projects/56333522598f43fd8968f11c79a46ebc` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.697667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] RBAC: Authorizing `identity:delete_project(project_id=56333522598f43fd8968f11c79a46ebc)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:08.700187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:08.766003 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56333522598f43fd8968f11c79a46ebc', 'request_id': 'req-6985012f-e34a-434e-b8c9-b6a0ff3699be'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.777042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56333522598f43fd8968f11c79a46ebc', 'request_id': 'req-6985012f-e34a-434e-b8c9-b6a0ff3699be'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.783717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56333522598f43fd8968f11c79a46ebc', 'request_id': 'req-6985012f-e34a-434e-b8c9-b6a0ff3699be'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.799036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] The token cache is being invalidate because project 56333522598f43fd8968f11c79a46ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:08.799361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.800120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6985012f-e34a-434e-b8c9-b6a0ff3699be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:08.801754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1241/2519] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:08 2022] DELETE /identity/v3/projects/56333522598f43fd8968f11c79a46ebc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:08.806842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.807567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.807732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.828339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:08.829810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:08.893832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1279/2520] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:08.903587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.903879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.904163 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.927099 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:08.928568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:08.937787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1242/2521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:08.942294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:08.953310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5506166-5b93-4899-b4a2-e89b1ad9dae9 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:08.969427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:08.970062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:08.970343 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:08.970617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:08.971308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:08.971870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:08.973502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:08.985219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:08.999630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1280/2522] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:09.001795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.015063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c73a8-358b-432c-9a9c-766ee9ed2e98 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.022504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.024012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.024394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.024737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.025531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.027557 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.063591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1243/2523] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:09 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:09.072674 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.084791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca556c6-96a4-4ea6-99e1-952200902e46 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.154085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.154790 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.155081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.155481 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.156186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.158297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.187183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1281/2524] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:09 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:09.189340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.201565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c252cbe-da3d-4cd3-b880-6a7f16028c31 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.206630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.207275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.207559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.207832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.208496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.210584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.222906 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1244/2525] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:09.227630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.240043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d5334-ac48-4f0b-8cf5-7fefdfe8e670 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.247270 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.248034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.248465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.249084 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.250095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.254242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea268b-05ee-429a-bead-e7d6bf3acef3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.266667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1282/2526] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:09.271037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.287738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c3f07-4e41-4a92-8ee9-bd3879a2c15c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.292967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.293631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.293913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.294202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] PATH_INFO: `/v3/projects/4e3c2993365240f1b626c66d8c972139/users/3f2431c088f4419391f54dfe6c7bcd9d/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.311211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3c2993365240f1b626c66d8c972139, user_id=3f2431c088f4419391f54dfe6c7bcd9d, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.313844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.329235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1245/2527] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:09 2022] PUT /identity/v3/projects/4e3c2993365240f1b626c66d8c972139/users/3f2431c088f4419391f54dfe6c7bcd9d/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:09.340122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.340405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.340701 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.370753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] MFA Rules not processed for user `3f2431c088f4419391f54dfe6c7bcd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:09.372129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:09.446395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1283/2528] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:09.456760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:09.458468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:09.502145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:09.521708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755ea1-1cfe-4ef3-8245-5c1cd1c79c68 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:09.526037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:09.526667 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:09.527086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:09.527401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:09.537956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:09.539889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b50b52-7e03-45fa-bb98-95071ea2579f service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:09.550368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1246/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:11.254860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:11.256506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:11.357983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d756-8094-4a3f-b49d-0ff7528018cc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:11.363088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:11.363766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:11.364048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:11.364328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] PATH_INFO: `/v3/users/c8718a4f73e0419cb0b2e7d3e4600646` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:11.365501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8718a4f73e0419cb0b2e7d3e4600646)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:11.368419 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:11.376835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:11.430597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8718a4f73e0419cb0b2e7d3e4600646'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:11.431339 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8718a4f73e0419cb0b2e7d3e4600646'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:11.439931 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8718a4f73e0419cb0b2e7d3e4600646'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:11.440703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8718a4f73e0419cb0b2e7d3e4600646'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:11.450179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8718a4f73e0419cb0b2e7d3e4600646'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:11.471360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1284/2530] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:11 2022] DELETE /identity/v3/users/c8718a4f73e0419cb0b2e7d3e4600646 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:11.475591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:11.476670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:11.476670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:11.498830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:11.500181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:11.569489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1247/2531] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:11.580471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:11.581951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:11.661574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340c48-6ca5-498d-843b-4fad0ea25289 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:11.666382 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:11.666996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:11.667305 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:11.667581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:11.677224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:11.678680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88059d-73e1-43b2-8cf6-7ce812995ad9 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:11.688858 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1285/2532] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:12.035009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.036995 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.054996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3982fc-805a-4b95-8ee7-7d3e7fcb5f55 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.063368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.065258 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.066123 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.066844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] PATH_INFO: `/v3/projects/4c5a5d1cf1ac4cf4a5886a77a823001a` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.068691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5a5d1cf1ac4cf4a5886a77a823001a)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.071446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.135980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5a5d1cf1ac4cf4a5886a77a823001a', 'request_id': 'req-f13aa957-337b-4cb8-90a9-cd0fd50f9153'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.145101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5a5d1cf1ac4cf4a5886a77a823001a', 'request_id': 'req-f13aa957-337b-4cb8-90a9-cd0fd50f9153'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.152207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5a5d1cf1ac4cf4a5886a77a823001a', 'request_id': 'req-f13aa957-337b-4cb8-90a9-cd0fd50f9153'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.166865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] The token cache is being invalidate because project 4c5a5d1cf1ac4cf4a5886a77a823001a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:12.167073 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.168042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f13aa957-337b-4cb8-90a9-cd0fd50f9153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.169855 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1248/2533] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:12 2022] DELETE /identity/v3/projects/4c5a5d1cf1ac4cf4a5886a77a823001a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:12.175110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.175495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.175812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.200276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:12.201746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.266259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1286/2534] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:12.273975 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.274342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.274624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.301910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:12.303085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.312509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1249/2535] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:12.316941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.329484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0657c-eeff-45e7-9187-6b71e8fc8d8a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.335291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.336072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.336428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.336778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.337440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:12.337741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.339423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.353133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1287/2536] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:12.357470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.367849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde42b-5845-4972-a0fb-8df3c96884ef None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.373059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.373710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.374000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.374282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.374938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.377360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.412693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1250/2537] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:12.418935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.434540 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e2e3b-3f1d-4bc0-8401-82e064ce3d12 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.447489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:12.499756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.500380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.500664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.500941 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.501592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.503732 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.526857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1288/2538] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:12.531476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.544834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb0a55-48bd-4d97-8e9c-371292d5707c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.549954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.550579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.550860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.551137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.551813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.553468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.565109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1251/2539] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:12.568712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.579632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3edc5-2080-4557-8c49-f1eb6d6bf12a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.584401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.585020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.585304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.586145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.586867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.588480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c0d29-8036-4b3f-b86f-89781d481cf6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.600796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1289/2540] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:12.605507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.615866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d9326-8068-432f-b055-c9c57b136b8d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.620834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.621489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.621771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.622067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] PATH_INFO: `/v3/projects/da36f5af12974efa9e3734865106e5a5/users/1fe23000f9834eabbfe6ee0903c32472/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.637386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da36f5af12974efa9e3734865106e5a5, user_id=1fe23000f9834eabbfe6ee0903c32472, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.640477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.650708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:12.656224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1252/2541] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:12 2022] PUT /identity/v3/projects/da36f5af12974efa9e3734865106e5a5/users/1fe23000f9834eabbfe6ee0903c32472/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:12.668715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.669074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.669280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.692882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.694607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.699571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] MFA Rules not processed for user `1fe23000f9834eabbfe6ee0903c32472`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:12.700993 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.772404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3370d-3e4e-45c3-a49d-fed63b16a01a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.777978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.778640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.778901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.779215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] PATH_INFO: `/v3/users/3f2431c088f4419391f54dfe6c7bcd9d` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.780364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2431c088f4419391f54dfe6c7bcd9d)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:12.782407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:12.795309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1290/2542] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:12.807458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.809198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.832829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2431c088f4419391f54dfe6c7bcd9d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.833618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2431c088f4419391f54dfe6c7bcd9d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.842586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2431c088f4419391f54dfe6c7bcd9d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.850828 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2431c088f4419391f54dfe6c7bcd9d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.851901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-36840d1c-2f09-4a98-8b34-3bf75a10bea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2431c088f4419391f54dfe6c7bcd9d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:12.871515 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1253/2543] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:12 2022] DELETE /identity/v3/users/3f2431c088f4419391f54dfe6c7bcd9d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:12.875970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.876369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.876487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a1a6a-a85f-4db5-84ca-83cd1ca358e4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:12.876753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.897002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:12.899103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.920038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:12.932944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:12.933553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:12.933831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:12.934275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:12.936493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:12.967888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1254/2544] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:12.978516 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:12.979974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:13.003093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.003671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:13.004820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.016603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1291/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:21:13.045863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a18a4-1014-47eb-8088-605d17b4a905 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.049771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.050389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.050674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.051021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.061323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.062786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6370f-5104-41da-9508-3a20594654a0 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.073734 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1255/2546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:21:13.388003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.389588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:13.408645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe1fcf-f0a0-4601-b13b-5f09a06ad185 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.413482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.414791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.415145 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.415507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] PATH_INFO: `/v3/projects/4e3c2993365240f1b626c66d8c972139` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.417431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3c2993365240f1b626c66d8c972139)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.419977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.470322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3c2993365240f1b626c66d8c972139', 'request_id': 'req-4da76d7e-a65b-45a0-a90f-ade22e9591bd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:13.477507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3c2993365240f1b626c66d8c972139', 'request_id': 'req-4da76d7e-a65b-45a0-a90f-ade22e9591bd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:13.485639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3c2993365240f1b626c66d8c972139', 'request_id': 'req-4da76d7e-a65b-45a0-a90f-ade22e9591bd'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:13.497778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] The token cache is being invalidate because project 4e3c2993365240f1b626c66d8c972139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:13.498044 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:13.499365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4da76d7e-a65b-45a0-a90f-ade22e9591bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:13.501222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1292/2547] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:13 2022] DELETE /identity/v3/projects/4e3c2993365240f1b626c66d8c972139 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:13.506235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.506511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.506777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.528915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:13.530159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:13.596670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1256/2548] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:13.605461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.605770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.606045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.627836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:13.629214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:13.638565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1293/2549] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:13.643292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.654414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bbe7a-d181-41d6-834d-7747fe17f803 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.659022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.659664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.659941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.660230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.660970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:13.661257 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.662864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.679063 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1257/2550] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:21:13.680695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.690609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376171a2-6746-416e-9a04-ee0fa5d332f5 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.696779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.697405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.697683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.697953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.698791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.700855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.732459 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1294/2551] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:13 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:13.737429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.747814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d1246-30e4-41e3-95d4-eee35c076d42 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.814682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.815485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.815813 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.816169 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.816879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.818927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.842279 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1258/2552] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:13 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:13.846498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.858354 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710ad7-1369-4944-913e-9b7ff267842c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.863203 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.863819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.864098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.864373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.865014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.866689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.877159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1295/2553] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:13.881327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.892907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b8ec2-442c-4a83-8b9d-f462412e2cf7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.897843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.899285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.899572 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.899848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.900490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.902106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa2c8-e84e-4bd2-92c3-163a1c0d60f7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.913400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1259/2554] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:13.917964 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:13.929871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a699130-06ea-4617-9013-0fcb7410f7b8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:13.935034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:13.935766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.936043 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.936315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] PATH_INFO: `/v3/projects/5dc7384b6e524c1989be7d702429d38e/users/2a08b17468754f8d9091d95d4198b565/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.954262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc7384b6e524c1989be7d702429d38e, user_id=2a08b17468754f8d9091d95d4198b565, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:13.956992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:13.971102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1296/2555] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:13 2022] PUT /identity/v3/projects/5dc7384b6e524c1989be7d702429d38e/users/2a08b17468754f8d9091d95d4198b565/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:13.976776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4b30-4e61-4dac-ab83-4dc686c6fca3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:13.977161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4b30-4e61-4dac-ab83-4dc686c6fca3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:13.977447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e4b30-4e61-4dac-ab83-4dc686c6fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:13.997690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-210e4b30-4e61-4dac-ab83-4dc686c6fca3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:13.998918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-210e4b30-4e61-4dac-ab83-4dc686c6fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:14.024948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:14.062663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1260/2556] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:14.073423 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:14.075261 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:14.090207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:14.136992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aed0b7-1b9c-491f-aec6-57806bffd12c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:14.143884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:14.144504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:14.144788 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:14.145063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:14.154867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:14.156341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b4317-dd28-4fce-bccc-e6d4e10de7c5 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:14.166775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1297/2557] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:14.418637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:14.418934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:14.419263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:14.441802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] MFA Rules not processed for user `1fe23000f9834eabbfe6ee0903c32472`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:14.443080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:14.506426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1261/2558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:15.720257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75740e85-b09b-42d4-b7ff-b732d9e6f382 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:15.721191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75740e85-b09b-42d4-b7ff-b732d9e6f382 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:15.721702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75740e85-b09b-42d4-b7ff-b732d9e6f382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:15.756766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-75740e85-b09b-42d4-b7ff-b732d9e6f382 None None] MFA Rules not processed for user `2a08b17468754f8d9091d95d4198b565`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:15.760022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-75740e85-b09b-42d4-b7ff-b732d9e6f382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:15.856162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1298/2559] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:15.868351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:15.871668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:15.943373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75665e53-3d2f-4426-a541-6fed848731d8 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:15.948423 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:15.949173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:15.949519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:15.949882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:15.961225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:15.962843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:15.975125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1262/2560] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:17.624004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:17.624574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:17.624574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:17.645190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] MFA Rules not processed for user `2a08b17468754f8d9091d95d4198b565`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:17.646506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:17.654317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1299/2561] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:22.336034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:22.354994 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b461-ded7-4f26-84e3-d6fd9277d0b4 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:22.361172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:22.361816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:22.362105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:22.362375 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:22.367360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:22.380378 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:22.382147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:22.392954 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1263/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:26.458206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:26.460676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:26.545195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:26.547592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:26.564360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc6a83-26a0-4415-92dd-97581ab474b4 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:26.584283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:26.584969 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:26.585298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:26.585766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] PATH_INFO: `/v3/users/b1b1cc84ccd54065b97df321d6a5dca1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:26.586956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b1cc84ccd54065b97df321d6a5dca1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:26.588938 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:26.593549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca05fde-31e8-48b5-acc8-f274d0cad47a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:26.598826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:26.599715 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:26.600001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:26.600282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:26.602748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:26.614634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:26.616909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:26.628469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1300/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:26.643352 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b1cc84ccd54065b97df321d6a5dca1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:26.644041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b1cc84ccd54065b97df321d6a5dca1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:26.653050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b1cc84ccd54065b97df321d6a5dca1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:26.657839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:26.661703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b1cc84ccd54065b97df321d6a5dca1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:26.662677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a011bd5b-034d-4204-a8d6-b2c5f881f9d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b1cc84ccd54065b97df321d6a5dca1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:26.682650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1264/2564] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:26 2022] DELETE /identity/v3/users/b1b1cc84ccd54065b97df321d6a5dca1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:26.867499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:26.878619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853410-c154-438a-b51c-0f4457853ce6 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:26.905713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:26.942462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:26.943012 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:26.943329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:26.943605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] PATH_INFO: `/v3/projects/658018ee8789463eaf76b2a39a34ae10` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:26.944987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658018ee8789463eaf76b2a39a34ae10)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:26.947089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:26.997183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658018ee8789463eaf76b2a39a34ae10', 'request_id': 'req-75f45ba1-38c6-4171-a338-5462bdaef548'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:27.002553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658018ee8789463eaf76b2a39a34ae10', 'request_id': 'req-75f45ba1-38c6-4171-a338-5462bdaef548'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:27.010482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658018ee8789463eaf76b2a39a34ae10', 'request_id': 'req-75f45ba1-38c6-4171-a338-5462bdaef548'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:27.021680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] The token cache is being invalidate because project 658018ee8789463eaf76b2a39a34ae10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:27.021973 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:27.023346 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-75f45ba1-38c6-4171-a338-5462bdaef548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:27.024846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1301/2565] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:26 2022] DELETE /identity/v3/projects/658018ee8789463eaf76b2a39a34ae10 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:27.029825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.030114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.030416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.051346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:27.052595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:27.114388 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1265/2566] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:27.122731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.123037 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.123341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.143831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:27.145053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:27.153825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1302/2567] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:27.158217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.168072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246285a-9f4a-4716-aaa8-e06f388f2853 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.172658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.173252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.173536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.173812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.174446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:27.174751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.176389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.188105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1266/2568] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:27.192562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.202373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d40b6-fa0d-4b2d-a3fd-0e744da5740a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.207404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.208004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.208285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.208560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.209193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.211961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.246458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1303/2569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:27.247823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.258884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2a071-632c-4b21-90df-1fcebc9c5afd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.328076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.329000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.329280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.329554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.330235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.332273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.366054 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1267/2570] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:27 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:27.368462 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.379870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008aa4-b26a-4778-9606-dc35eea2edde admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.385517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.386210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.386492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.386930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.387620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.389475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.404213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1304/2571] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:27.405740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.416255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6462f-900a-4d4f-9f5a-fca9ae7732e7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.420908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.421511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.421784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.422056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.422716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.424372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57db9f-18ad-4431-91c3-77a13ba72f0c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.435556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1268/2572] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:27.439833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.450405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291675e0-fea5-4972-84bd-d41de5ba0f6b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.455266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.455913 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.456192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.456463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] PATH_INFO: `/v3/projects/69d931693782413d8d37c6cf59a80e2a/users/6048df2889ec472885b542d938c783a9/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.470896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d931693782413d8d37c6cf59a80e2a, user_id=6048df2889ec472885b542d938c783a9, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.473596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.486664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1305/2573] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:27 2022] PUT /identity/v3/projects/69d931693782413d8d37c6cf59a80e2a/users/6048df2889ec472885b542d938c783a9/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:27.498605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.498892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.499179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.528372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] MFA Rules not processed for user `6048df2889ec472885b542d938c783a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:27.529601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:27.563562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:27.603657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1269/2574] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:27.614518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:27.616811 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:27.682920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:27.705668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5e4c-0c4c-4658-b9bb-91a107657466 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:27.711720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:27.712328 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:27.712609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:27.712882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:27.721430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:27.723100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57743b5f-bf67-45c2-8795-0473fc571ee8 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:27.733436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1306/2575] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:27.968140 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:28.035367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707afca-58da-4af5-b37e-108d33ec142a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:28.039953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:28.040621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.040901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.041178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] PATH_INFO: `/v3/users/6048df2889ec472885b542d938c783a9` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.042305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6048df2889ec472885b542d938c783a9)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:28.044269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:28.099289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6048df2889ec472885b542d938c783a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.099953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6048df2889ec472885b542d938c783a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.107890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6048df2889ec472885b542d938c783a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.115382 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6048df2889ec472885b542d938c783a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.116036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6048df2889ec472885b542d938c783a9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.134154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1270/2576] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:27 2022] DELETE /identity/v3/users/6048df2889ec472885b542d938c783a9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:28.138747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.139042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.139349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.161579 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:28.162816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:28.232274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1307/2577] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:28.242605 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:28.244483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:28.321222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6ec81-5d44-40ec-98b0-47050bb356e9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:28.324944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:28.325559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.325839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.326116 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.332496 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:28.338355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:28.340616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb708e-1535-4e2a-9d50-69d137bc2901 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:28.352095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1271/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:28.685893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:28.687471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:28.700243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b26fcd-3a7a-4154-a07a-438502f07034 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:28.705380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:28.706022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.706309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.706585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] PATH_INFO: `/v3/projects/69d931693782413d8d37c6cf59a80e2a` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.707762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d931693782413d8d37c6cf59a80e2a)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:28.709716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:28.763586 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d931693782413d8d37c6cf59a80e2a', 'request_id': 'req-d365dcbc-b044-4c6c-bcde-532706533672'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.769381 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d931693782413d8d37c6cf59a80e2a', 'request_id': 'req-d365dcbc-b044-4c6c-bcde-532706533672'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.777478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d931693782413d8d37c6cf59a80e2a', 'request_id': 'req-d365dcbc-b044-4c6c-bcde-532706533672'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.790289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] The token cache is being invalidate because project 69d931693782413d8d37c6cf59a80e2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:28.790571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.791347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d365dcbc-b044-4c6c-bcde-532706533672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:28.792865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1308/2579] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:28 2022] DELETE /identity/v3/projects/69d931693782413d8d37c6cf59a80e2a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:28.797816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.798326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.798449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.820083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:28.821326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:28.883384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1272/2580] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:28.891241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.891631 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.891994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.914477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:28.915855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:28.925911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1309/2581] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:28.930934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:28.941078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58c29-f167-4775-80f2-a5d4b6616ae7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:28.946369 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:28.946974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.947295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.947574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.948215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:28.948518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:28.950195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:28.966309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1273/2582] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:28.967551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:28.977223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051744c0-7da5-408f-89dd-49accab2f47a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:28.982104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:28.982703 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:28.983028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:28.983311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:28.983937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:28.985852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.021927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1310/2583] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:28 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:29.023497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.036303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62076d-d0be-4d88-abf3-7957e2849a0c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.113021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.113980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.114480 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.114944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.115830 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.119372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.155765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1274/2584] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:29 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:29.156747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.176835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50eab5-16a1-42f0-8b4e-71e205e761b5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.186507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.187561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.188046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.188512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.189356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.191282 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.204342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1311/2585] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:29.207993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.220035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84330a6-122f-4799-b9e6-72edfd82288d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.233262 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.233887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.234166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.234847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.235076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.236749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ae88c-d7b2-4c81-8051-5c58059619b3 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.269671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1275/2586] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:29.271355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.285198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b8d85-ddfc-4b17-8312-b276040cfae1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.291575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.292250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.292532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.292870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] PATH_INFO: `/v3/projects/c4715e36af5d4a25b61d2faf2bd74edb/users/727a99d539da47089d196463e5160476/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.309304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4715e36af5d4a25b61d2faf2bd74edb, user_id=727a99d539da47089d196463e5160476, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.311922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.321706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:29.327767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1312/2587] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:29 2022] PUT /identity/v3/projects/c4715e36af5d4a25b61d2faf2bd74edb/users/727a99d539da47089d196463e5160476/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:29.338800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.339235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.339604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.371082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] MFA Rules not processed for user `727a99d539da47089d196463e5160476`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:29.372373 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:29.420597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:29.440837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1276/2588] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:29.445460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.507030 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc5b9-ebbf-4afc-a3ff-cf6d9cca654e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.511865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.512503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.512791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.513064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.513706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.515699 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.543810 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1313/2589] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:29 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:29.548143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.559697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c673e5-60ad-4cde-b163-acb4ae5f041f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.620840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.621458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.621740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.622026 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.622648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.624606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.653387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1277/2590] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:29 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:29.658805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.677885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99230ad-c812-443c-9ac7-88c8cf516172 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.685687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.686718 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.687350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.687712 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.688770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.691757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.711754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1314/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:29.716317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.727565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765af1-41fd-4af2-b6a5-1a2841ada8cd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.732309 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.732972 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.733282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.733560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] PATH_INFO: `/v3/projects/10189b334a884ff5bbd45f1b86498e31/users/82b9cc045bc9460c8ec9f9135bed1699/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.749157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] RBAC: Authorizing `identity:create_grant(project_id=10189b334a884ff5bbd45f1b86498e31, user_id=82b9cc045bc9460c8ec9f9135bed1699, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.751917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.766321 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1278/2592] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:29 2022] PUT /identity/v3/projects/10189b334a884ff5bbd45f1b86498e31/users/82b9cc045bc9460c8ec9f9135bed1699/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:29.770872 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.782004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61efae-2e01-4703-8e92-d915221424e8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.841349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.841874 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.842157 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.842432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.843063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.844717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7539a2-af61-48b1-9cbe-e4ea78b82bf0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.855519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1315/2593] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:29.859792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:29.870627 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931460d-b6d2-4a33-be1f-e94f2d24986e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:29.875431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:29.876110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.876371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.876641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] PATH_INFO: `/v3/projects/10189b334a884ff5bbd45f1b86498e31/users/82b9cc045bc9460c8ec9f9135bed1699/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.878618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10189b334a884ff5bbd45f1b86498e31, user_id=82b9cc045bc9460c8ec9f9135bed1699, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:29.881241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:29.892349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1279/2594] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:29 2022] PUT /identity/v3/projects/10189b334a884ff5bbd45f1b86498e31/users/82b9cc045bc9460c8ec9f9135bed1699/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:29.904421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:29.904714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:29.904996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:29.939206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] MFA Rules not processed for user `82b9cc045bc9460c8ec9f9135bed1699`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:29.940435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:30.002367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:30.013288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1316/2595] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:30.025569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:30.027329 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:30.086283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535b4a1-a423-4a88-83db-e3408e9c63d5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:30.090181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:30.090793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:30.091072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:30.091426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:30.101082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:30.103849 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0192db-5faf-439c-9627-f7be17146104 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:30.114239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1280/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:30.606601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:30.680777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643d170-2e81-486a-bf80-8b2582d9ac73 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:30.685893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:30.686531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:30.686808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:30.687395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] PATH_INFO: `/v3/users/727a99d539da47089d196463e5160476` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:30.688275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727a99d539da47089d196463e5160476)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:30.690350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:30.740789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727a99d539da47089d196463e5160476'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:30.742086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727a99d539da47089d196463e5160476'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:30.749596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727a99d539da47089d196463e5160476'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:30.750384 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727a99d539da47089d196463e5160476'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:30.758209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727a99d539da47089d196463e5160476'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:30.777727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1317/2597] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:30 2022] DELETE /identity/v3/users/727a99d539da47089d196463e5160476 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:30.782371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf72c-0067-497a-922e-9314cb942156 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:30.782653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf72c-0067-497a-922e-9314cb942156 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:30.782927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cf72c-0067-497a-922e-9314cb942156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:30.802208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-443cf72c-0067-497a-922e-9314cb942156 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:30.803433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-443cf72c-0067-497a-922e-9314cb942156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:30.845186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:30.865688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1281/2598] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:30.876387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:30.877827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:30.941547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48699fe1-ada5-4e39-b7e6-518b39f90933 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:30.945608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:30.946212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:30.946491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:30.946764 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:30.957055 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:30.958515 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:30.968456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1318/2599] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:31.244474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cf72c-0067-497a-922e-9314cb942156 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:31.246009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-443cf72c-0067-497a-922e-9314cb942156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:31.264156 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cf72c-0067-497a-922e-9314cb942156 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:31.270175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:31.270827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:31.271150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:31.271385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] PATH_INFO: `/v3/projects/c4715e36af5d4a25b61d2faf2bd74edb` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:31.273296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4715e36af5d4a25b61d2faf2bd74edb)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:31.275543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:31.332582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4715e36af5d4a25b61d2faf2bd74edb', 'request_id': 'req-7df7ba2a-4916-4071-800c-3fac64a1957d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.341303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4715e36af5d4a25b61d2faf2bd74edb', 'request_id': 'req-7df7ba2a-4916-4071-800c-3fac64a1957d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.349081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4715e36af5d4a25b61d2faf2bd74edb', 'request_id': 'req-7df7ba2a-4916-4071-800c-3fac64a1957d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.364821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] The token cache is being invalidate because project c4715e36af5d4a25b61d2faf2bd74edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:31.365209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.365981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.368441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1282/2600] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:31 2022] DELETE /identity/v3/projects/c4715e36af5d4a25b61d2faf2bd74edb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:31.372344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:31.383702 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357a070-11bf-42b5-ad6e-d05febe16f27 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:31.402659 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:31.476220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:31.477165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:31.477517 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:31.478013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] PATH_INFO: `/v3/users/82b9cc045bc9460c8ec9f9135bed1699` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:31.480467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b9cc045bc9460c8ec9f9135bed1699)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:31.482794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:31.554597 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b9cc045bc9460c8ec9f9135bed1699'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.554977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b9cc045bc9460c8ec9f9135bed1699'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.564745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b9cc045bc9460c8ec9f9135bed1699'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.566307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b9cc045bc9460c8ec9f9135bed1699'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.575759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-7726d38d-dab2-45c8-95a6-8ba8c86b8fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b9cc045bc9460c8ec9f9135bed1699'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:31.628967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1319/2601] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:31 2022] DELETE /identity/v3/users/82b9cc045bc9460c8ec9f9135bed1699 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:32.057113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.058601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:32.101565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ba2a-4916-4071-800c-3fac64a1957d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.268596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.269067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.269398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.269790 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] PATH_INFO: `/v3/projects/10189b334a884ff5bbd45f1b86498e31` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.273034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10189b334a884ff5bbd45f1b86498e31)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.278452 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.351659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10189b334a884ff5bbd45f1b86498e31', 'request_id': 'req-6a7035b7-0151-4f19-8944-121c7b2b16d9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:32.373213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10189b334a884ff5bbd45f1b86498e31', 'request_id': 'req-6a7035b7-0151-4f19-8944-121c7b2b16d9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:32.382635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10189b334a884ff5bbd45f1b86498e31', 'request_id': 'req-6a7035b7-0151-4f19-8944-121c7b2b16d9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:32.390508 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:32.396670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] The token cache is being invalidate because project 10189b334a884ff5bbd45f1b86498e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:32.397460 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:32.398187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6a7035b7-0151-4f19-8944-121c7b2b16d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:32.404114 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1283/2602] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:32 2022] DELETE /identity/v3/projects/10189b334a884ff5bbd45f1b86498e31 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:32.405946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.406740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.406740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.427531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:32.429580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:32.503028 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1320/2603] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:32.511250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.511541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.511848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.532213 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:32.533531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:32.542476 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1284/2604] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:32.546881 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.558096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6841b8-3e84-4db6-96b1-0db662a5d4d6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.563010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.563642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.563919 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.564188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.564834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:32.565126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.567337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.579257 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1321/2605] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:32.583629 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.593101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222442c7-524d-442e-b422-49e2c3a4fc15 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.598146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.598760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.599042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.599387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.600050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.602517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.632784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1285/2606] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:32 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:32.637249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.648338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf829cb-2cac-4dbc-a047-e71d2e7d3b65 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.670444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:32.713899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.714499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.714861 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.715412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.716120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.718449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.744223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1322/2607] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:32 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:32.752347 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.775863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae6443-0bbf-49b4-a390-214732d05102 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.784575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.785477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.785976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.786407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.787552 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.790689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.802361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1286/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:32.806869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.818676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162b15e-7401-4104-a7d6-611c668370e6 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.823698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.824311 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.824590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.824943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.825578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.827273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc80f-46ae-4b47-b445-ad2afc47d3af admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.840073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1323/2609] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:32.844408 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:32.861096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0e86c-71ca-4df6-8ff8-ae8cbc283b29 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:32.868997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:32.869908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.870367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.870809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] PATH_INFO: `/v3/projects/118d82fb6ba147daa22e047398d332f9/users/8254e62910364c0799f15eafe2e909d3/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.911270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] RBAC: Authorizing `identity:create_grant(project_id=118d82fb6ba147daa22e047398d332f9, user_id=8254e62910364c0799f15eafe2e909d3, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:32.918872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:32.954187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1287/2610] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:32 2022] PUT /identity/v3/projects/118d82fb6ba147daa22e047398d332f9/users/8254e62910364c0799f15eafe2e909d3/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:32.956278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:32.956565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:32.956836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:32.992894 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] MFA Rules not processed for user `8254e62910364c0799f15eafe2e909d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:32.994117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:33.061072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1324/2611] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:33.065770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.129421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490e2-a662-4a42-8bd6-cd31d92b168f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.134847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.135491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.135768 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.136040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.136680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.138589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.165732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1288/2612] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:33 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:33.170069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.181634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515b155-33f2-42c6-b349-a9ce65af6993 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.245574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.246199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.246479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.246823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.247871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.249751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.274309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1325/2613] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:33 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:33.280832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.292225 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fcac0-5b97-41d7-863f-a83d90dd90dc admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.297130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.297781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.298103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.299188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.299188 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.301137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.312968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1289/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:33.317405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.330121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e45b10-3204-41c7-a07a-fd0cbf30ceea admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.335468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.336400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.336678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.336947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] PATH_INFO: `/v3/projects/d8102ba058404e11a547776d943d9c4e/users/394bedcb39724bd19ab7fbd1d3eee15d/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.353625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8102ba058404e11a547776d943d9c4e, user_id=394bedcb39724bd19ab7fbd1d3eee15d, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.356310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.364503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:33.372827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1326/2615] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:33 2022] PUT /identity/v3/projects/d8102ba058404e11a547776d943d9c4e/users/394bedcb39724bd19ab7fbd1d3eee15d/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:33.376839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.387563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0217d40-8209-46d3-a488-60dfc55514ad admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.444802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.445621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.445898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.446171 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.446798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.448433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410cf57-dac9-47ab-9079-035490f94794 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.458475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1290/2616] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:33.462875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.473519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15c0dc-5207-48ab-8d04-df4e7cdbeb57 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.478445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.479087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.479403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.479676 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] PATH_INFO: `/v3/projects/d8102ba058404e11a547776d943d9c4e/users/394bedcb39724bd19ab7fbd1d3eee15d/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.481594 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8102ba058404e11a547776d943d9c4e, user_id=394bedcb39724bd19ab7fbd1d3eee15d, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.484292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.495080 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1327/2617] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:33 2022] PUT /identity/v3/projects/d8102ba058404e11a547776d943d9c4e/users/394bedcb39724bd19ab7fbd1d3eee15d/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:33.505400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.505692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.505991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.514706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:33.536256 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] MFA Rules not processed for user `394bedcb39724bd19ab7fbd1d3eee15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:33.537489 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:33.606737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1291/2618] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:33.618555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.620297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:33.679519 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f149-0276-4185-af8d-d4dfe6b43d6a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.683194 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.683792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.684071 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.684341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.693492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.695638 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8102d-8567-4dcf-9896-0549a88fb829 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.705224 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1328/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:33.789531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:33.799523 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c633d-537f-44b3-bf57-bd054da00756 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:33.803122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:33.803788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:33.804196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:33.804471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:33.863980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:33.867920 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034358e-ff3b-478c-9899-68c09920cfc4 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:33.878898 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1292/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:34.026014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:34.027262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:34.027262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:34.049441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:34.050724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:34.122882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1329/2621] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:34.133752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1603be-c13c-45f2-b29f-e51f3ba12a68 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:34.134206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1603be-c13c-45f2-b29f-e51f3ba12a68 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:34.134326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1603be-c13c-45f2-b29f-e51f3ba12a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:34.145963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:34.148034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:34.156625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7c1603be-c13c-45f2-b29f-e51f3ba12a68 None None] MFA Rules not processed for user `2a08b17468754f8d9091d95d4198b565`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:34.158074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7c1603be-c13c-45f2-b29f-e51f3ba12a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:34.232711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1293/2622] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:34.242834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeda0f9-b601-4e38-a67f-1a8c6b0359e7 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:34.249636 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:34.250294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:34.250697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:34.250819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:34.261252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:34.262912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:34.273341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1330/2623] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:21:34.924246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548ffa-8b8c-4d21-98c1-cc2a76981c3f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:34.924499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548ffa-8b8c-4d21-98c1-cc2a76981c3f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:34.925010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a548ffa-8b8c-4d21-98c1-cc2a76981c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:34.950457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8a548ffa-8b8c-4d21-98c1-cc2a76981c3f None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:34.951751 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8a548ffa-8b8c-4d21-98c1-cc2a76981c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:34.960832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1294/2624] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:21:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:34.978598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:34.990286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3085bf2-2e90-4b1c-85c5-a93357f74860 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:34.996493 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:34.997299 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:34.997605 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:34.997862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:35.006629 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:35.008839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:35.019413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1331/2625] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:21:35.289624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fe74-0f86-4a8d-884a-c576c7bab51d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:35.290138 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fe74-0f86-4a8d-884a-c576c7bab51d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:35.290361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2fe74-0f86-4a8d-884a-c576c7bab51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:35.317247 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-cba2fe74-0f86-4a8d-884a-c576c7bab51d None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:35.318815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-cba2fe74-0f86-4a8d-884a-c576c7bab51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:35.328547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1295/2626] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:21:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:35.342551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:35.358181 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92025c-7bab-4e66-b498-7af662edfc58 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:35.365371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:35.366859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:35.367312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:35.367687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:35.375260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:35.378326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:35.380762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:35.398273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1332/2627] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:21:35.807456 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:35.807739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:35.808018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:35.830600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:35.831858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:35.840097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1296/2628] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:21:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:35.853812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:35.864768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb4f95-384a-44ab-b9e1-6a0f074bbacb service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:35.870192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:35.870787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:35.871061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:35.871365 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:35.879700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:35.881289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cacafe-5a76-48c9-b580-06c93500d4c3 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:35.891169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1333/2629] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:21:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:21:36.782630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:36.802351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=100 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:37.010943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8951e7c-86a3-4ec9-b7ad-17b082da8665 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:37.017367 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:37.018037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:37.018314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:37.018587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] PATH_INFO: `/v3/users/8254e62910364c0799f15eafe2e909d3` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:37.019774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8254e62910364c0799f15eafe2e909d3)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:37.021719 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:37.079982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8254e62910364c0799f15eafe2e909d3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:37.081013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8254e62910364c0799f15eafe2e909d3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:37.096539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8254e62910364c0799f15eafe2e909d3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:37.108870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8254e62910364c0799f15eafe2e909d3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:37.109665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8254e62910364c0799f15eafe2e909d3'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:37.148109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1297/2630] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:36 2022] DELETE /identity/v3/users/8254e62910364c0799f15eafe2e909d3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:37.153307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:37.153744 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:37.153986 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:37.177495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:37.179922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:37.254749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1334/2631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:37.273394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:37.275551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:37.358992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fa9ca-138d-498f-804d-0b5d3eea710d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:37.362762 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:37.363410 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:37.363747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:37.364023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:37.375072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:37.376546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:37.386885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1298/2632] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:37.870208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:37.872068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:37.896266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e6ee6-44d5-4168-9d27-6caadd94254e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:37.904773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:37.905668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:37.906045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:37.906389 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] PATH_INFO: `/v3/projects/118d82fb6ba147daa22e047398d332f9` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:37.907974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=118d82fb6ba147daa22e047398d332f9)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:37.910815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:38.012309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118d82fb6ba147daa22e047398d332f9', 'request_id': 'req-a176148c-2acc-4417-828c-b53d614eb9cb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.018593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118d82fb6ba147daa22e047398d332f9', 'request_id': 'req-a176148c-2acc-4417-828c-b53d614eb9cb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.034610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118d82fb6ba147daa22e047398d332f9', 'request_id': 'req-a176148c-2acc-4417-828c-b53d614eb9cb'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.052245 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] The token cache is being invalidate because project 118d82fb6ba147daa22e047398d332f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:38.052769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.054375 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.056443 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1335/2633] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:37 2022] DELETE /identity/v3/projects/118d82fb6ba147daa22e047398d332f9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:38.061791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:38.075815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63c11e-03f9-44c8-8c05-55c300a2f53c service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:38.133057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.182711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:38.186040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:38.186985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:38.187336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:38.187721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:38.188157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] PATH_INFO: `/v3/users/394bedcb39724bd19ab7fbd1d3eee15d` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:38.190263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394bedcb39724bd19ab7fbd1d3eee15d)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:38.192562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:38.208806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176148c-2acc-4417-828c-b53d614eb9cb admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:38.230908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:38.230908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:38.235275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:38.235733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] PATH_INFO: `/v3/users/1fe23000f9834eabbfe6ee0903c32472` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:38.238407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe23000f9834eabbfe6ee0903c32472)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:38.244488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:38.271909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394bedcb39724bd19ab7fbd1d3eee15d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.273990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394bedcb39724bd19ab7fbd1d3eee15d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.305754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394bedcb39724bd19ab7fbd1d3eee15d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.318314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394bedcb39724bd19ab7fbd1d3eee15d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.319677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2e397401-92ce-402e-b881-229e5c51f555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394bedcb39724bd19ab7fbd1d3eee15d'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.344740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1299/2634] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:38 2022] DELETE /identity/v3/users/394bedcb39724bd19ab7fbd1d3eee15d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:38.348902 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe23000f9834eabbfe6ee0903c32472'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.349976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe23000f9834eabbfe6ee0903c32472'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.361220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe23000f9834eabbfe6ee0903c32472'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.362133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe23000f9834eabbfe6ee0903c32472'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.372772 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.376177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe23000f9834eabbfe6ee0903c32472'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.433544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1336/2635] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:38 2022] DELETE /identity/v3/users/1fe23000f9834eabbfe6ee0903c32472 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:38.438682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859456-be27-422d-a524-2253bf861018 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:38.439097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859456-be27-422d-a524-2253bf861018 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:38.439292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859456-be27-422d-a524-2253bf861018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:38.467338 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0a859456-be27-422d-a524-2253bf861018 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:38.468670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0a859456-be27-422d-a524-2253bf861018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:38.555649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1300/2636] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:38.565984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:38.567367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:38.636066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a36c5e-61c4-4f49-847d-fb8dd694012c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:38.640286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:38.640826 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:38.641330 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:38.641584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:38.653961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:38.655683 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:38.670249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1337/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:38.867064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859456-be27-422d-a524-2253bf861018 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:38.868610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0a859456-be27-422d-a524-2253bf861018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:38.882780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859456-be27-422d-a524-2253bf861018 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:38.888087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:38.888867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:38.889314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:38.889593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] PATH_INFO: `/v3/projects/d8102ba058404e11a547776d943d9c4e` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:38.890791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8102ba058404e11a547776d943d9c4e)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:38.892759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:38.955066 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8102ba058404e11a547776d943d9c4e', 'request_id': 'req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.956771 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:38.965263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8102ba058404e11a547776d943d9c4e', 'request_id': 'req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.972801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:38.974383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:38.978102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8102ba058404e11a547776d943d9c4e', 'request_id': 'req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.995062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ca75-76a8-4a6a-b76c-da08a73c14bc service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:38.995298 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] The token cache is being invalidate because project d8102ba058404e11a547776d943d9c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:38.995622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.996343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d4b97ac3-7b5b-4fa1-b305-842a42e4055a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:38.998251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1301/2638] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:38 2022] DELETE /identity/v3/projects/d8102ba058404e11a547776d943d9c4e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:39.003292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb84f-cecb-451b-8b73-d95f4550e305 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.003597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb84f-cecb-451b-8b73-d95f4550e305 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.003896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eb84f-cecb-451b-8b73-d95f4550e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.027781 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-b94eb84f-cecb-451b-8b73-d95f4550e305 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:39.029005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b94eb84f-cecb-451b-8b73-d95f4550e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:39.066912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.068193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.068482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.068756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] PATH_INFO: `/v3/projects/da36f5af12974efa9e3734865106e5a5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.070131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da36f5af12974efa9e3734865106e5a5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.072193 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.097057 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1302/2639] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:39.106147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.106453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.106754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.129624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:39.130871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:39.133248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da36f5af12974efa9e3734865106e5a5', 'request_id': 'req-b8d6952a-f4be-4b16-b3e9-79b887d852c2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:39.139668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da36f5af12974efa9e3734865106e5a5', 'request_id': 'req-b8d6952a-f4be-4b16-b3e9-79b887d852c2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:39.148729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da36f5af12974efa9e3734865106e5a5', 'request_id': 'req-b8d6952a-f4be-4b16-b3e9-79b887d852c2'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:39.160710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] The token cache is being invalidate because project da36f5af12974efa9e3734865106e5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:39.161021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:39.161731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:39.164136 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1338/2640] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:38 2022] DELETE /identity/v3/projects/da36f5af12974efa9e3734865106e5a5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:39.221212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1303/2641] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:39.226618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.237781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6952a-f4be-4b16-b3e9-79b887d852c2 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.243449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.244254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.244543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.244825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.245495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:39.245802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.247549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.255551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:39.263269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1339/2642] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:39.268589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.285544 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018324ab-5182-43dd-9f2d-56342bc607c1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.292108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.292847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.293199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.293542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.294269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.296511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.329222 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1304/2643] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:39.333727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.344757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05e0ed-c4c2-4873-9fbf-1a2c877057b4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.422174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.422847 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.423131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.423438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.424093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.426062 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.450035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1340/2644] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:39.456076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.467524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7be359-21bc-45f2-aef6-3341ed1cc864 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.472490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.473009 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.473282 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.473555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.474189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.476540 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.488787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1305/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:39.493297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.503799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009fcd-b444-4489-967e-c8e0414bd124 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.508678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.509286 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.509563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.509839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.510486 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.512162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef197b-6045-4dd8-b9c7-5e4708a56838 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.523131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1341/2646] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:39.527747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.538386 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872605c-001d-4677-9920-c9778b50a934 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.543350 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.543988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.544263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.544537 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] PATH_INFO: `/v3/projects/16fda88db33a43158bc97a799c816a25/users/6d99e43da99d4cf4b5bdef33cd6c83e6/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.561582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fda88db33a43158bc97a799c816a25, user_id=6d99e43da99d4cf4b5bdef33cd6c83e6, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.564394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.579982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1306/2647] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:39 2022] PUT /identity/v3/projects/16fda88db33a43158bc97a799c816a25/users/6d99e43da99d4cf4b5bdef33cd6c83e6/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:39.592797 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.593233 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.593644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.623669 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] MFA Rules not processed for user `6d99e43da99d4cf4b5bdef33cd6c83e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:39.625064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:39.718608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1342/2648] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:39.726692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.774289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:39.833590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce25b4-9ddc-466e-a5e8-9aaa0e938501 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.839224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.840133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.840485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.840838 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:39.841554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:39.843584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:39.874965 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1307/2649] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/projects => generated 401 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:39.882333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:39.919816 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d354863-83eb-450c-8652-245aa33f22cd None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:39.997979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:39.998716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:39.998994 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:39.999327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.000582 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.002530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.014502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:40.029222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1343/2650] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:39 2022] POST /identity/v3/users => generated 307 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:40.033333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.044407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a395b8-c7a0-4047-bd19-0b01708ef699 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.049825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.050545 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.050835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.051182 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.051783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.053840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.064911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1308/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:40.069654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.080550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06c137-5605-43e8-8397-3ddaaecb13e3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.086432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.087105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.087471 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.087751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] PATH_INFO: `/v3/projects/0d9a4c95704f42b0b2c73460fd163086/users/c1f46fa2467a45a69937898296df6bfc/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.106598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9a4c95704f42b0b2c73460fd163086, user_id=c1f46fa2467a45a69937898296df6bfc, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.109776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.128289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1344/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:40 2022] PUT /identity/v3/projects/0d9a4c95704f42b0b2c73460fd163086/users/c1f46fa2467a45a69937898296df6bfc/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:40.133243 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.144072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f8d0-503f-4188-94a4-1cda62844692 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.225217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.225909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.226343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.226664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.227354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.229018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42f88e-d2d9-4dcf-85ea-afdfd44ea0cd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.244068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1309/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:40.248446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.262746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59145-9b8f-4610-abc0-054b9924ea1a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.271923 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.272925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.273206 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.273482 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] PATH_INFO: `/v3/projects/0d9a4c95704f42b0b2c73460fd163086/users/c1f46fa2467a45a69937898296df6bfc/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.275690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9a4c95704f42b0b2c73460fd163086, user_id=c1f46fa2467a45a69937898296df6bfc, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.278433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.299182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1345/2654] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:40 2022] PUT /identity/v3/projects/0d9a4c95704f42b0b2c73460fd163086/users/c1f46fa2467a45a69937898296df6bfc/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:40.304909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.305193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.305467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.364964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] MFA Rules not processed for user `c1f46fa2467a45a69937898296df6bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:40.366890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:40.503953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1310/2655] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:40 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:40.518694 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.521121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:40.597862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8feb74-1266-42f9-91f9-63d44bf0e285 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.602183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.603038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.603543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.604047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.613984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.615497 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.627407 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1346/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:40 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:40.738874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:40.757380 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a961a-e070-45b3-8cdd-6bd32710de95 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:40.761501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:40.762339 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:40.762622 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:40.762893 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:40.782668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:40.839980 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:40.841425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a0ee6-9915-432e-8387-c9798b7d8c33 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:40.853242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1311/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:40 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:45.135287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.201555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bba64-7980-4c22-8c76-14aeda258067 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.207132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.207840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.208120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.208411 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] PATH_INFO: `/v3/users/6d99e43da99d4cf4b5bdef33cd6c83e6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.210463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d99e43da99d4cf4b5bdef33cd6c83e6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.212823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.263409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d99e43da99d4cf4b5bdef33cd6c83e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:45.264076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d99e43da99d4cf4b5bdef33cd6c83e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:45.273279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d99e43da99d4cf4b5bdef33cd6c83e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:45.274110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d99e43da99d4cf4b5bdef33cd6c83e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:45.283178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d99e43da99d4cf4b5bdef33cd6c83e6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:45.285944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:45.315543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1347/2658] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:45 2022] DELETE /identity/v3/users/6d99e43da99d4cf4b5bdef33cd6c83e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:45.322198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.322814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.322944 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.343772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:45.345036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.409608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1312/2659] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:45.419600 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.421244 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.484251 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bfcc9-5c69-407f-9ae8-511054ebba5c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.488003 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.488615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.488900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.489177 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.499766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.501230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.512370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1348/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:45.896127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:45.897807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:45.910364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921894c-1507-4ec3-a15f-22978e1e6ad3 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:45.925782 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:45.926457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:45.926706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:45.927035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] PATH_INFO: `/v3/projects/16fda88db33a43158bc97a799c816a25` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:45.928711 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16fda88db33a43158bc97a799c816a25)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:45.930628 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:45.993413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16fda88db33a43158bc97a799c816a25', 'request_id': 'req-545a83ed-98ec-41ac-a195-0afefdbc2871'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.001398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16fda88db33a43158bc97a799c816a25', 'request_id': 'req-545a83ed-98ec-41ac-a195-0afefdbc2871'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.007283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16fda88db33a43158bc97a799c816a25', 'request_id': 'req-545a83ed-98ec-41ac-a195-0afefdbc2871'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.018795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] The token cache is being invalidate because project 16fda88db33a43158bc97a799c816a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:46.019108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.019778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.021364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1313/2661] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:45 2022] DELETE /identity/v3/projects/16fda88db33a43158bc97a799c816a25 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:46.025476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:46.035345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332d222-3073-462b-8f95-b26a6ac2d372 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.102317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.102317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.102317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.102317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] PATH_INFO: `/v3/users/c1f46fa2467a45a69937898296df6bfc` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.103126 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f46fa2467a45a69937898296df6bfc)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.105135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.169046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f46fa2467a45a69937898296df6bfc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.170243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f46fa2467a45a69937898296df6bfc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.199671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f46fa2467a45a69937898296df6bfc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.200404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f46fa2467a45a69937898296df6bfc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.210220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-ae051738-371c-4fdc-acba-7f0550b39548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f46fa2467a45a69937898296df6bfc'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.242230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1349/2662] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:46 2022] DELETE /identity/v3/users/c1f46fa2467a45a69937898296df6bfc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:46.681227 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:46.682756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.696686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a83ed-98ec-41ac-a195-0afefdbc2871 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:46.737686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.758641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:46.759315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.759593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.759864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] PATH_INFO: `/v3/projects/0d9a4c95704f42b0b2c73460fd163086` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.760990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9a4c95704f42b0b2c73460fd163086)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:46.762932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:46.812660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9a4c95704f42b0b2c73460fd163086', 'request_id': 'req-b7e986d6-9d4c-4417-8229-15febaaad545'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.821044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9a4c95704f42b0b2c73460fd163086', 'request_id': 'req-b7e986d6-9d4c-4417-8229-15febaaad545'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.827103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9a4c95704f42b0b2c73460fd163086', 'request_id': 'req-b7e986d6-9d4c-4417-8229-15febaaad545'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.839582 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] The token cache is being invalidate because project 0d9a4c95704f42b0b2c73460fd163086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:46.839931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.840593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b7e986d6-9d4c-4417-8229-15febaaad545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:46.842166 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1314/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:46 2022] DELETE /identity/v3/projects/0d9a4c95704f42b0b2c73460fd163086 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:46.847007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.847362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.847642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.855700 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:46.871171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:46.872568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.939550 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1350/2664] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:46.948577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:46.949113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:46.949638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:46.976566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:46.977792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:46.987795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1315/2665] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:46.992598 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.004275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465c799-c8c1-44b1-897f-a78a9240986a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.010333 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.011186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.011502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.011778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.012454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:47.012720 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.014369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.030442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1351/2666] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:47.031625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.041270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547be23-45af-4b02-9d76-a999ad20f2cb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.046004 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.046607 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.046889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.047192 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.047837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.049725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.079877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1316/2667] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:47.084168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.094434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2af33d-8d2b-474f-b2ef-559e6c223472 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.150171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.150775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.151057 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.151363 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.151991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.153948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.175106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1352/2668] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:47.180033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.190826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e9741-7c09-422c-8da1-910027c3dfe4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.196556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.197179 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.197454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.197722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.198401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.200006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.210307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1317/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:47.214217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.224149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6391e-3502-4878-94e4-e3e150bb52bf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.228781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.229371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.229653 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.229927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.230560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.232213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591dd0fc-50ed-46a6-b341-fd8bdbfd8b31 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.243272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1353/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:47.247481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.258780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5aee-effa-42aa-89ce-5ae3b0813b77 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.263415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.264069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.264341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.264606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] PATH_INFO: `/v3/projects/973b815d383e48709282afe4d6c77620/users/5d517894fa8c470e84e51f1e05590994/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.279534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973b815d383e48709282afe4d6c77620, user_id=5d517894fa8c470e84e51f1e05590994, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.282154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.296172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1318/2671] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:47 2022] PUT /identity/v3/projects/973b815d383e48709282afe4d6c77620/users/5d517894fa8c470e84e51f1e05590994/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:47.308370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.308660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.308942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.338169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] MFA Rules not processed for user `5d517894fa8c470e84e51f1e05590994`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:47.339538 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.409117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.418917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1354/2672] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:47.420051 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.438325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.439758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.487754 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2bc5-886d-4764-a6c9-d1d510245662 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.493082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.493692 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.493976 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.494252 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.494923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.496909 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.498689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf87783-1ca2-4f68-bf9d-6dc4e5e09933 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.502949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.503666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.503953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.504229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.506013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.508351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:47.522031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.523573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.526848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1319/2673] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:47.530864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.537842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1355/2674] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:21:47.594579 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacf45-1fff-4711-87f4-4a6ff7dc3c45 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.600360 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.601255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.601718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.601996 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.602635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.604657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.627253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1320/2675] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:47.631238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.640952 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20281e-b73b-4e6e-8934-e5dd78758613 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.645690 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.646296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.646580 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.647510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.648331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.649961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.660046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1356/2676] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:47.664776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.674977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5374ea4-d94d-4230-aec4-13638850dd99 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.680153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.680850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.681196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.681475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] PATH_INFO: `/v3/projects/9c0e55083c1c47cb948a0aa6bc065731/users/9a21f595169d400f971967aee0059316/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.698789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0e55083c1c47cb948a0aa6bc065731, user_id=9a21f595169d400f971967aee0059316, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.701478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.715793 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1321/2677] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:47 2022] PUT /identity/v3/projects/9c0e55083c1c47cb948a0aa6bc065731/users/9a21f595169d400f971967aee0059316/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:47.719535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.730441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17292ac-6d01-460e-b8f2-c8e6b0955b58 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.793292 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.794034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.794324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.794601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.795279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.797143 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f32b7-588d-47de-a332-f288fcef49d0 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.807721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1357/2678] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:47.811860 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:47.822290 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750834d0-3465-4e81-a051-90e5c468f48d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:47.827466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:47.828203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.828485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.829018 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] PATH_INFO: `/v3/projects/9c0e55083c1c47cb948a0aa6bc065731/users/9a21f595169d400f971967aee0059316/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.831084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0e55083c1c47cb948a0aa6bc065731, user_id=9a21f595169d400f971967aee0059316, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:47.833744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:47.845586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1322/2679] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:47 2022] PUT /identity/v3/projects/9c0e55083c1c47cb948a0aa6bc065731/users/9a21f595169d400f971967aee0059316/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:47.856717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:47.857089 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:47.857433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:47.893098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] MFA Rules not processed for user `9a21f595169d400f971967aee0059316`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:47.893821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:47.993377 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1358/2680] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:48.014575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:48.016832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:48.099406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eae2d9-a2fc-4899-b0e6-6e30a6b2014b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:48.103620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:48.104246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:48.104592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:48.104776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:48.114923 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:48.116693 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:48.127203 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1323/2681] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:48.211992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:48.223023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c3e0-9e89-497f-9e56-2f298c275f8c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:48.227823 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:48.228557 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:48.228846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:48.229134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:48.239098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:48.303568 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:48.305228 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e4d44-54e4-4a5c-94af-739a6cc8bf4d service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:48.315693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1359/2682] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:48.624239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:48.681080 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:48.698616 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5185e-3540-4ab1-9a2c-04722e8f7eae service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:48.703384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:48.704268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:48.704560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:48.704817 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] PATH_INFO: `/v3/users/5d517894fa8c470e84e51f1e05590994` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:48.705961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d517894fa8c470e84e51f1e05590994)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:48.708036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:48.766433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d517894fa8c470e84e51f1e05590994'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.767269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d517894fa8c470e84e51f1e05590994'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.784181 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d517894fa8c470e84e51f1e05590994'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.793435 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d517894fa8c470e84e51f1e05590994'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.794500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d517894fa8c470e84e51f1e05590994'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:48.814289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1324/2683] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:48 2022] DELETE /identity/v3/users/5d517894fa8c470e84e51f1e05590994 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:48.819065 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:48.819537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:48.820050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:48.839933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:48.841161 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:48.915290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1360/2684] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:48.923095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:48.926589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:48.995604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369c069-c768-47f0-b39c-663a9aee49ef admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:48.999727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:49.000448 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:49.000825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:49.001231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:49.012983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:49.014421 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:49.025534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1325/2685] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:49.312729 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:49.314906 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:49.333293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbaae4-1c5d-44cd-9c48-df9e838630ee None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:49.342502 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:49.343473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:49.343839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:49.344801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] PATH_INFO: `/v3/projects/973b815d383e48709282afe4d6c77620` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:49.347019 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=973b815d383e48709282afe4d6c77620)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:49.349609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:49.402723 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973b815d383e48709282afe4d6c77620', 'request_id': 'req-808645e2-9980-47b0-81c1-088e01cd8a4d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.408438 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973b815d383e48709282afe4d6c77620', 'request_id': 'req-808645e2-9980-47b0-81c1-088e01cd8a4d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.418516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973b815d383e48709282afe4d6c77620', 'request_id': 'req-808645e2-9980-47b0-81c1-088e01cd8a4d'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.430232 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] The token cache is being invalidate because project 973b815d383e48709282afe4d6c77620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:49.430527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.431219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-808645e2-9980-47b0-81c1-088e01cd8a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.432698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1361/2686] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:49 2022] DELETE /identity/v3/projects/973b815d383e48709282afe4d6c77620 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:49.436746 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:49.446351 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7460b-8ad2-4c8c-b21e-06f38373425a service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:49.534584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:49.535482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:49.535822 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:49.536180 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] PATH_INFO: `/v3/users/9a21f595169d400f971967aee0059316` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:49.538664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a21f595169d400f971967aee0059316)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:49.541069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:49.554713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:49.585514 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:49.585928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:49.586320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:49.611133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:49.612491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:49.616756 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a21f595169d400f971967aee0059316'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.617586 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a21f595169d400f971967aee0059316'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.629559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a21f595169d400f971967aee0059316'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.640611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a21f595169d400f971967aee0059316'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.641402 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a21f595169d400f971967aee0059316'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:49.656199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:49.674226 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1326/2687] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:49 2022] DELETE /identity/v3/users/9a21f595169d400f971967aee0059316 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:49.699801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1362/2688] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Sep 19 11:21:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:49.707618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:49.709970 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:49.832374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828cf52-2507-4272-bfa9-ce4ef1d32fe9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:49.841354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:49.842105 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:49.842712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:49.842842 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:49.938555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:49.940363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165b370-482b-48ed-b5ef-5c1aadfb463b service swift] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:49.955201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1327/2689] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 19 11:21:50.033291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:50.034832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:50.073716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d6d8b-2a42-4f72-90a5-057e35786e26 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:50.177647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:50.177647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.177647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.177647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] PATH_INFO: `/v3/projects/9c0e55083c1c47cb948a0aa6bc065731` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.180227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0e55083c1c47cb948a0aa6bc065731)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:50.185002 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:50.310789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0e55083c1c47cb948a0aa6bc065731', 'request_id': 'req-48aa1598-94ee-4c4b-8b86-b95a016dbd46'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:50.319961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0e55083c1c47cb948a0aa6bc065731', 'request_id': 'req-48aa1598-94ee-4c4b-8b86-b95a016dbd46'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:50.331129 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0e55083c1c47cb948a0aa6bc065731', 'request_id': 'req-48aa1598-94ee-4c4b-8b86-b95a016dbd46'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:50.346418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] The token cache is being invalidate because project 9c0e55083c1c47cb948a0aa6bc065731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:50.346773 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:50.347495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-48aa1598-94ee-4c4b-8b86-b95a016dbd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:50.351113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1363/2690] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:50 2022] DELETE /identity/v3/projects/9c0e55083c1c47cb948a0aa6bc065731 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:50.358115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.358700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.359364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.431029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:50.439137 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:50.489615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:50.583874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1328/2691] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:50.644048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.644480 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.644870 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.681041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:50.682394 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:50.698118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1364/2692] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:50.700535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:50.714992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfa8ad-3a81-4ab7-84b2-bf88b91d3c5f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:50.720738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:50.721366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.721647 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.722060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.722716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:50.723023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:50.725852 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:50.738535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1329/2693] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:50.744120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:50.761558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf833fb-3352-4602-a3b3-816c2e21c135 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:50.769839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:50.770664 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.771214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.772054 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.773069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:50.775440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:50.819897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1365/2694] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:50 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:50.820827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:50.839102 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788fc3-4e30-436b-9bd1-6f0e2d0997dd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:50.967288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:50.968103 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:50.983214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:50.983530 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:50.984218 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:50.986198 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:51.063072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1330/2695] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:50 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:51.067207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:51.084688 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d5fd2-f97f-45bd-b9b3-434cb3c3f211 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:51.096717 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:51.097131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:51.097809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:51.097809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:51.098320 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:51.101041 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:51.126023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1366/2696] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:51.129548 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:51.154284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85370fdd-6c64-4fd8-8850-8c88fc02d56f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:51.171646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:51.172737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:51.173128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:51.173507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:51.174261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:51.180941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2801bd-1a05-40ed-87bc-305b9dc0ab41 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:51.202550 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1331/2697] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:51.207171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:51.219908 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96f95e-5af6-4645-a87a-705335828be1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:51.227414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:51.228799 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:51.229095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:51.229405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] PATH_INFO: `/v3/projects/dee1f1f69ef443558617a4e2956524b5/users/6d2a34c264aa4607a91292fd7638be19/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:51.265696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee1f1f69ef443558617a4e2956524b5, user_id=6d2a34c264aa4607a91292fd7638be19, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:51.268835 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:51.289293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1367/2698] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:51 2022] PUT /identity/v3/projects/dee1f1f69ef443558617a4e2956524b5/users/6d2a34c264aa4607a91292fd7638be19/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:51.304401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:51.304749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:51.305101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:51.372167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] MFA Rules not processed for user `6d2a34c264aa4607a91292fd7638be19`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:51.373957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:51.532854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1332/2699] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:51.542326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:51.544117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:51.573857 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:51.662714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e32f2-9f6b-49b3-8bbd-20f7a7bc4297 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:51.669268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12546450f8af46a3816cd8e75e9d3ed2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:51.673162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:51.673315 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:51.673635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:51.687331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:51.689135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:51.703456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1368/2700] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:52.317002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:52.320394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:52.365666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:52.465280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6446af4-93e5-42ba-ad75-eed0d1ff0cb1 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:52.470886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:52.472569 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:52.473401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:52.473783 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] PATH_INFO: `/v3/users/cc4e6ebb70d2450ab66c68b19d82b7ab` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:52.476305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4e6ebb70d2450ab66c68b19d82b7ab)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:52.478851 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:52.567132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4e6ebb70d2450ab66c68b19d82b7ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:52.567924 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4e6ebb70d2450ab66c68b19d82b7ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:52.579649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4e6ebb70d2450ab66c68b19d82b7ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:52.587633 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4e6ebb70d2450ab66c68b19d82b7ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:52.588310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-659adac3-da9e-4bae-b834-930bad9e0441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4e6ebb70d2450ab66c68b19d82b7ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:52.610531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1333/2701] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:52 2022] DELETE /identity/v3/users/cc4e6ebb70d2450ab66c68b19d82b7ab => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:52.869134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:52.887651 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac159ee3-8b05-4c0f-a96a-138f5a4e7f7a service glance] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.002449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.004165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.004791 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.005086 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] PATH_INFO: `/v3/projects/4f8b8b3ba11f45389c64985a1ee1481b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.007421 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8b8b3ba11f45389c64985a1ee1481b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.009506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.066838 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8b8b3ba11f45389c64985a1ee1481b', 'request_id': 'req-249a57a2-7665-4bfb-9e47-b0194fa42bd9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:53.074120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8b8b3ba11f45389c64985a1ee1481b', 'request_id': 'req-249a57a2-7665-4bfb-9e47-b0194fa42bd9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:53.083359 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8b8b3ba11f45389c64985a1ee1481b', 'request_id': 'req-249a57a2-7665-4bfb-9e47-b0194fa42bd9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:53.097929 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] The token cache is being invalidate because project 4f8b8b3ba11f45389c64985a1ee1481b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:53.098522 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:53.099225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-249a57a2-7665-4bfb-9e47-b0194fa42bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:53.101306 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1369/2702] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:52 2022] DELETE /identity/v3/projects/4f8b8b3ba11f45389c64985a1ee1481b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:53.105989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.106370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.106846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.128083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:53.129332 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:53.196807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1334/2703] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:53.206237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.206530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.206817 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.230765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:53.232367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:53.240167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1370/2704] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:21:53.244731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.255283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045b7ec-d86e-4f3b-9204-93f0c98900da None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.262725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.263718 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.264000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.264340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.265148 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:53.265446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.267599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.283787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1335/2705] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:21:53.293279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.303564 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aef3e-6647-4bac-afb1-02938c8e52a3 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.308954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.309619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.309854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.310137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.310775 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.312782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.354692 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1371/2706] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:53 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:53.356005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.368324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0deab-d148-47f9-9bb1-9d216248e12b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.422487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:53.461549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.462359 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.462779 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.463505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.464650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.466709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.491926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1336/2707] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:53 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:53.495760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.510983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2000bd-c662-4994-80f8-a015ee173898 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.533910 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.535196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.535487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.535883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.536543 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.539127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.555643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1372/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:53.557476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:53.558426 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.570829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bddb0-54af-4171-a0a7-7f258e987fef admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.577615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.578558 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.579285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.579409 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.580053 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.581688 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cf87da-c34b-43d6-a16e-db6dbcdd81aa admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.596609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1337/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:53.608004 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.620660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d5a7-dd28-4d8a-9b54-b1d2882bcd54 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.625590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.626269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.626524 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.626792 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] PATH_INFO: `/v3/projects/03fe40c42d0849b6b7069fcec3683b2c/users/97b8fd47ca9443e98363d2314c8fa2f8/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.645473 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03fe40c42d0849b6b7069fcec3683b2c, user_id=97b8fd47ca9443e98363d2314c8fa2f8, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.650189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.668081 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1373/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:53 2022] PUT /identity/v3/projects/03fe40c42d0849b6b7069fcec3683b2c/users/97b8fd47ca9443e98363d2314c8fa2f8/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:53.679458 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.679707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.679989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.714425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] MFA Rules not processed for user `97b8fd47ca9443e98363d2314c8fa2f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:53.715602 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:53.788512 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1338/2711] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:53.801445 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:53.803287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:53.885578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b63bf-d151-4c7b-aae0-12e21a634d38 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:53.892231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:53.892951 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:53.893327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:53.893666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:53.903840 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:53.905461 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc933a-4df1-432e-b337-24e390e318a1 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:53.916535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1374/2712] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:56.795546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:56.883694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc868e-9ba6-4faf-a42c-9e4cab0c83f5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:56.889305 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:56.889878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:56.890160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:56.890431 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] PATH_INFO: `/v3/users/97b8fd47ca9443e98363d2314c8fa2f8` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:56.892086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b8fd47ca9443e98363d2314c8fa2f8)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:56.893795 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:56.950936 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:56.960891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b8fd47ca9443e98363d2314c8fa2f8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:56.961742 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b8fd47ca9443e98363d2314c8fa2f8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:56.971601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b8fd47ca9443e98363d2314c8fa2f8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:56.980562 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b8fd47ca9443e98363d2314c8fa2f8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:56.981288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b8fd47ca9443e98363d2314c8fa2f8'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.007901 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1339/2713] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:21:56 2022] DELETE /identity/v3/users/97b8fd47ca9443e98363d2314c8fa2f8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:21:57.009960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.010541 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.010770 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.039709 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:57.041284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:57.123312 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1375/2714] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:57.134966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:57.136792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:57.233076 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09e044-175e-4628-bd6e-d60f9cece724 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:57.239381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:57.240377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.240853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.241637 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.255029 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:57.257398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d2133-90eb-471d-9895-0a37cc44fc31 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:57.268697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1340/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:57.620208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:57.621985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:57.639842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105fc39-62ff-4b92-815d-2ae1eb83a9d6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:57.653267 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:57.654101 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.654390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.654673 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] PATH_INFO: `/v3/projects/03fe40c42d0849b6b7069fcec3683b2c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.656119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03fe40c42d0849b6b7069fcec3683b2c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:57.658209 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:57.713574 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03fe40c42d0849b6b7069fcec3683b2c', 'request_id': 'req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.717667 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:57.720404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03fe40c42d0849b6b7069fcec3683b2c', 'request_id': 'req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.729477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03fe40c42d0849b6b7069fcec3683b2c', 'request_id': 'req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.742256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] The token cache is being invalidate because project 03fe40c42d0849b6b7069fcec3683b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:21:57.742529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.743278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-b407e5c7-36ab-4a2f-a80a-512bd191e7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:21:57.745167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1376/2716] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:21:57 2022] DELETE /identity/v3/projects/03fe40c42d0849b6b7069fcec3683b2c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:57.750146 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.750733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.750733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.774085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:57.775816 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:57.858940 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1341/2717] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:57.868391 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.869169 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.869824 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.898535 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:57.900304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:57.915190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1377/2718] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:57.919364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:57.933706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de065cf0-a797-4262-b52a-c46e793915d7 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:57.938984 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:57.939691 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.940052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.940389 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.941097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:21:57.941468 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:57.943136 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:57.962186 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1342/2719] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:21:57.964117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:57.979293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f7ce-9772-4d14-bcad-2e89a64caec6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:57.986361 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:57.987125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:57.987821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:57.987821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:57.989331 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:57.991469 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.033464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1378/2720] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:57 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:58.039108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:58.055081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961d549-70f4-4893-89f3-593e2f6a97c9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:58.114955 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:58.133143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:58.134173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.134639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.134946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.135568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:58.137499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.167727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1343/2721] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:58 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:58.172357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:58.186696 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d46f-4955-4c27-8069-043ad08eb949 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:58.193223 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:58.194621 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.194965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.195183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.195883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:58.197554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.209165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1379/2722] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:58.213879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:58.230453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73318fd-f2e9-4b90-b47f-bc64fe35ce2d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:58.237617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:58.238573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.238869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.239297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.240890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:58.243466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7de81a-dd93-4c2a-8af0-eac41f68088f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.263869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1344/2723] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:21:58.266260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:58.287900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2710ba2-986a-49a3-ba94-52fdcf4cce21 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:58.297397 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:58.298422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.298942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.299396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] PATH_INFO: `/v3/projects/698863c6338a4f2aa40056a5d1e1156b/users/6ffdf89697324c91a5c6c52fe42c3f50/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.327063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698863c6338a4f2aa40056a5d1e1156b, user_id=6ffdf89697324c91a5c6c52fe42c3f50, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:58.331456 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.354383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1380/2724] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:58 2022] PUT /identity/v3/projects/698863c6338a4f2aa40056a5d1e1156b/users/6ffdf89697324c91a5c6c52fe42c3f50/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:58.360045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec1c8-ea69-4920-9c41-b6672f895ea3 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.360645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec1c8-ea69-4920-9c41-b6672f895ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.361153 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec1c8-ea69-4920-9c41-b6672f895ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.395917 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-267ec1c8-ea69-4920-9c41-b6672f895ea3 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:58.398314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-267ec1c8-ea69-4920-9c41-b6672f895ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:58.500919 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1345/2725] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:58.516494 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:58.518555 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:58.592435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c025c-6b3b-4131-a51f-03b05d9f3803 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:58.596590 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:58.597433 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:58.597713 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:58.597984 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:58.608953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:58.610509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:58.621569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1381/2726] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:21:59.435670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:59.436447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:59.436853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:59.488314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] MFA Rules not processed for user `6ffdf89697324c91a5c6c52fe42c3f50`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:21:59.489606 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:21:59.627208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1346/2727] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:21:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:21:59.632472 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:59.649262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a28df-fe27-4544-9791-70c05fab3b0a service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:59.662724 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:59.664351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:59.664820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:59.666021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:59.666680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:59.671123 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:59.720110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1382/2728] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:21:59 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:21:59.723631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:59.736997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abec78b-65ca-4562-bcb8-569d636e1616 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:59.806023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:21:59.819992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:59.820887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:59.821354 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:59.821801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:59.822641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:59.824908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:59.859438 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1347/2729] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:21:59 2022] POST /identity/v3/users => generated 309 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:21:59.860681 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:59.872165 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ce2e0-45ab-48ef-9008-9cdc7fda138b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:59.877167 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:59.877768 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:59.878104 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:59.878317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:59.878990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:59.880630 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:59.895191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1383/2730] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:21:59.900467 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:59.914601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a367b7-69b5-454f-9908-8b59016b027e admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:21:59.919873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:21:59.920827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:21:59.921086 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:21:59.921564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] PATH_INFO: `/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444/users/a0b3b92e428d441ca099f172ba380bd1/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:21:59.942172 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffdfdd49d3845c7b854d3e4b59f3444, user_id=a0b3b92e428d441ca099f172ba380bd1, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:21:59.946200 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:21:59.968261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1348/2731] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:21:59 2022] PUT /identity/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444/users/a0b3b92e428d441ca099f172ba380bd1/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:21:59.973544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:21:59.988386 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18becfc-5745-4e0f-a031-3f806546679c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:00.067415 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:00.087074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:00.088215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:00.089026 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:00.089308 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:00.090272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:00.092440 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ef4c0-f054-4dc7-ad19-8af7648df46f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:00.111302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1384/2732] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:00.117399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:00.131469 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd42fe7-335b-45dc-8eac-b257839c0821 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:00.136507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:00.137275 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:00.137618 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:00.137983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] PATH_INFO: `/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444/users/a0b3b92e428d441ca099f172ba380bd1/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:00.140074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffdfdd49d3845c7b854d3e4b59f3444, user_id=a0b3b92e428d441ca099f172ba380bd1, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:00.142809 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:00.154977 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1349/2733] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:00 2022] PUT /identity/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444/users/a0b3b92e428d441ca099f172ba380bd1/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:00.956325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:00.956924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:00.956924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:01.013752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] MFA Rules not processed for user `a0b3b92e428d441ca099f172ba380bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:01.015260 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:01.168368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1385/2734] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:02.506738 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:02.607077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4c2b0-dc15-422a-9f01-2be18b1daf11 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:02.612915 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:02.613556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:02.613839 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:02.614110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] PATH_INFO: `/v3/users/6ffdf89697324c91a5c6c52fe42c3f50` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:02.615343 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ffdf89697324c91a5c6c52fe42c3f50)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:02.617368 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:02.677922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ffdf89697324c91a5c6c52fe42c3f50'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:02.678642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ffdf89697324c91a5c6c52fe42c3f50'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:02.688111 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ffdf89697324c91a5c6c52fe42c3f50'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:02.697926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ffdf89697324c91a5c6c52fe42c3f50'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:02.699197 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ffdf89697324c91a5c6c52fe42c3f50'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:02.726837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1350/2735] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:02 2022] DELETE /identity/v3/users/6ffdf89697324c91a5c6c52fe42c3f50 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:02.948704 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:02.967868 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d229f15-0a4e-43a1-b67a-1fa44a2bd64e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:03.068731 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:03.069417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:03.069716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:03.069974 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] PATH_INFO: `/v3/projects/698863c6338a4f2aa40056a5d1e1156b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:03.071199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698863c6338a4f2aa40056a5d1e1156b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:03.073127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:03.130272 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698863c6338a4f2aa40056a5d1e1156b', 'request_id': 'req-32fa2841-7814-4fc8-8e67-66d59b861f58'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.137370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698863c6338a4f2aa40056a5d1e1156b', 'request_id': 'req-32fa2841-7814-4fc8-8e67-66d59b861f58'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.148199 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698863c6338a4f2aa40056a5d1e1156b', 'request_id': 'req-32fa2841-7814-4fc8-8e67-66d59b861f58'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.158485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:03.164039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] The token cache is being invalidate because project 698863c6338a4f2aa40056a5d1e1156b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:03.164551 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.166258 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.168966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1386/2736] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:02 2022] DELETE /identity/v3/projects/698863c6338a4f2aa40056a5d1e1156b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:03.174888 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:03.177044 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:03.199025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeb143-a9bb-49a8-9e04-cf8be0db0618 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:03.239010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:03.312798 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:03.313823 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:03.314293 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:03.314764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] PATH_INFO: `/v3/users/a0b3b92e428d441ca099f172ba380bd1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:03.316630 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b3b92e428d441ca099f172ba380bd1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:03.320291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:03.392960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b3b92e428d441ca099f172ba380bd1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.393988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b3b92e428d441ca099f172ba380bd1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.406652 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b3b92e428d441ca099f172ba380bd1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.422310 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b3b92e428d441ca099f172ba380bd1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.424336 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-72503b3d-4fa7-4880-8ef1-3746a82bab69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b3b92e428d441ca099f172ba380bd1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:03.460967 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1351/2737] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:03 2022] DELETE /identity/v3/users/a0b3b92e428d441ca099f172ba380bd1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:03.838570 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:03.840338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:03.858609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa2841-7814-4fc8-8e67-66d59b861f58 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:03.973191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:03.982316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:03.982316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:03.982316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] PATH_INFO: `/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:03.983647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffdfdd49d3845c7b854d3e4b59f3444)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:03.989637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.082839 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffdfdd49d3845c7b854d3e4b59f3444', 'request_id': 'req-4a718cc1-fb76-4976-91e3-19f54b6a9523'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:04.091866 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffdfdd49d3845c7b854d3e4b59f3444', 'request_id': 'req-4a718cc1-fb76-4976-91e3-19f54b6a9523'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:04.112005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffdfdd49d3845c7b854d3e4b59f3444', 'request_id': 'req-4a718cc1-fb76-4976-91e3-19f54b6a9523'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:04.139573 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] The token cache is being invalidate because project 4ffdfdd49d3845c7b854d3e4b59f3444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:04.140279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:04.141779 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4a718cc1-fb76-4976-91e3-19f54b6a9523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:04.145249 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1387/2738] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:03 2022] DELETE /identity/v3/projects/4ffdfdd49d3845c7b854d3e4b59f3444 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:04.153566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.155050 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.155857 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.185620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:04.187730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:04.275313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1352/2739] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:04.294072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.294491 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.294889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.331449 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:04.333240 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:04.359678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1388/2740] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:04.361129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.376960 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274afd21-ae70-44d5-91f5-3c9d5b88f211 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.392876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.393520 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.394093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.394713 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.395294 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:04.396036 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.402207 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.431272 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1353/2741] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:04.435085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.459617 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db30ab-5ae8-42d2-82b9-cf66bf90418d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.464895 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.465616 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.465944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.466322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.467035 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.469275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.502946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1389/2742] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:04.510387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.521775 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72a47-bceb-42dc-adab-02e9b88687f9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.564521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:04.600374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.601110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.601481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.601825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.602673 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.604810 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.631220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1354/2743] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:04.636214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.648113 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d9e90-36e5-4be8-aa86-ad67f8f46746 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.653533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.654229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.654511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.654787 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.655589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.657303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.669932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1390/2744] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:22:04.675680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.687418 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1f8c3-8b36-441f-81cd-1eb412b0d8a9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.693825 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.694541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.694854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.695112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.695806 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.697551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460612b7-f77a-40d4-973f-b1eb06f4d153 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.711270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1355/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:22:04.716176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:04.733769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d0561-96b6-4b06-81d3-4afb6545e7e8 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:04.739146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:04.740259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.740259 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.740748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] PATH_INFO: `/v3/projects/e5bd2e01426d4ab6b17d9cd6b580697b/users/2d09f8fc4754451b8bc4e9709720f9d1/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.758562 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bd2e01426d4ab6b17d9cd6b580697b, user_id=2d09f8fc4754451b8bc4e9709720f9d1, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:04.761756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:04.781920 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1391/2746] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:04 2022] PUT /identity/v3/projects/e5bd2e01426d4ab6b17d9cd6b580697b/users/2d09f8fc4754451b8bc4e9709720f9d1/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:04.792608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:04.792892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:04.793170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:04.827089 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] MFA Rules not processed for user `2d09f8fc4754451b8bc4e9709720f9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:04.828507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:04.991233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1356/2747] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:04.995448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.043760 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:05.091210 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cc646-f824-4116-9f5b-1fd159e1524c admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.098447 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.099188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.099848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.100133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.100871 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.102888 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.135885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1392/2748] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:04 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:05.140635 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.169413 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625148-1a67-4e6f-aff4-e8e863456ee8 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.242769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.243441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.243792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.244239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.244989 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.247012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.279251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1357/2749] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:05 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:05.281307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.301170 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e847a8b-4fdb-4363-a172-f452883c983b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.309007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.309778 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.310124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.310578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.311746 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.314863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.339304 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1393/2750] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:05.341173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.357187 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae012-7edd-435a-ae96-b39859729165 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.363921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.364872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.365270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.366175 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] PATH_INFO: `/v3/projects/1796d454ec14497fb7e8b561f32996ca/users/77fb2d55914a420085ee1d8a77fe00e9/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.388442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1796d454ec14497fb7e8b561f32996ca, user_id=77fb2d55914a420085ee1d8a77fe00e9, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.393999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.416453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1358/2751] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:05 2022] PUT /identity/v3/projects/1796d454ec14497fb7e8b561f32996ca/users/77fb2d55914a420085ee1d8a77fe00e9/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:22:05.421392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.436403 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fa71f-7042-4cf5-8eb6-4ba6d942ae33 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.511796 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.512786 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.513248 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.513537 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.514195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.516021 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79310f-671b-470d-920b-a6215139ad8a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.535640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1394/2752] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:05.542584 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.567846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a670-85a6-45a3-9578-99f7ccf04dc5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.574115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.574792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.575071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.575444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] PATH_INFO: `/v3/projects/1796d454ec14497fb7e8b561f32996ca/users/77fb2d55914a420085ee1d8a77fe00e9/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.577434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1796d454ec14497fb7e8b561f32996ca, user_id=77fb2d55914a420085ee1d8a77fe00e9, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.580429 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.585269 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:05.598477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1359/2753] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:05 2022] PUT /identity/v3/projects/1796d454ec14497fb7e8b561f32996ca/users/77fb2d55914a420085ee1d8a77fe00e9/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:05.609798 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.610231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.610819 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.644759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] MFA Rules not processed for user `77fb2d55914a420085ee1d8a77fe00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:05.647254 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:05.734884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1395/2754] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:05.747231 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.749109 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:05.814311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598a55f-b36d-494d-9078-9ef4563a5a82 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.819371 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.820189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.820535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.820882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.831617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:05.833060 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dcf2df-a9a4-427a-a407-c504e21e699c service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:05.844108 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1360/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:05.935074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:05.948111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008df0c4-830b-4d3e-931a-0c740a048a1f None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:05.952800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:05.953962 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:05.954344 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:05.954808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:05.992884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:06.039958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:06.041400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:06.055314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1396/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:14.128891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:14.129374 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:14.129485 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:14.148872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:14.150047 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:14.203547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1361/2757] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:22:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:14.216010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:14.217431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:14.289050 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e51be-359a-4b19-96eb-862098208547 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:14.293504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:14.294117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:14.294398 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:14.294672 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:14.303777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:14.305373 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:14.313390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1397/2758] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:22:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:22:16.287249 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:16.289747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:16.369466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de549496-00c7-46d6-9cf6-5ce4466267cb None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:16.374037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:16.374690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:16.374978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:16.375316 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] PATH_INFO: `/v3/users/2a08b17468754f8d9091d95d4198b565` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:16.376450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a08b17468754f8d9091d95d4198b565)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:16.378478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:16.426037 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:16.428335 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a08b17468754f8d9091d95d4198b565'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.429459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a08b17468754f8d9091d95d4198b565'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.437144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a08b17468754f8d9091d95d4198b565'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.444708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a08b17468754f8d9091d95d4198b565'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.445546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-f955bbd4-c71f-4cb5-a1dd-09bfdfc717b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a08b17468754f8d9091d95d4198b565'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.463792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1362/2759] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:16 2022] DELETE /identity/v3/users/2a08b17468754f8d9091d95d4198b565 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:16.639102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:16.651846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdfb2-6542-46fc-b830-4f9f949e5934 service swift] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:16.713297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:16.713937 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:16.714219 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:16.714596 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] PATH_INFO: `/v3/projects/5dc7384b6e524c1989be7d702429d38e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:16.715762 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc7384b6e524c1989be7d702429d38e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:16.717859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:16.776014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc7384b6e524c1989be7d702429d38e', 'request_id': 'req-475a136e-7507-4d50-881b-bbc37b410773'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.778508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:16.784274 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc7384b6e524c1989be7d702429d38e', 'request_id': 'req-475a136e-7507-4d50-881b-bbc37b410773'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.794526 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc7384b6e524c1989be7d702429d38e', 'request_id': 'req-475a136e-7507-4d50-881b-bbc37b410773'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.806529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] The token cache is being invalidate because project 5dc7384b6e524c1989be7d702429d38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:16.806827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.807530 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-475a136e-7507-4d50-881b-bbc37b410773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:16.809069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1398/2760] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:16 2022] DELETE /identity/v3/projects/5dc7384b6e524c1989be7d702429d38e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:16.814033 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:16.814323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:16.814601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:16.835824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:16.837031 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:16.902866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1363/2761] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:16.910370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:16.910662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:16.910933 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:16.934215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:16.935727 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:16.949138 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1399/2762] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:16.950654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:16.961232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c511d-a481-48ea-b5d4-504362dfb6bc None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:16.966021 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:16.966626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:16.966912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:16.967220 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:16.967868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:16.968230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:16.969758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:16.981991 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1364/2763] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:16.986323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.000212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5639f8f-6fc1-474b-b773-55c8708dacea None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.005049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.006288 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.006571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.007068 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.007753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.009671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.040131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1400/2764] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:16 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:17.044648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.056453 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a52ef0-b935-4833-8eb3-e91c20d80fe7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.117280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.118503 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.118963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.119270 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.119946 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.122847 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.145650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1365/2765] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:17 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:17.151250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.175316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f8a30-4567-4b24-8385-47652f608b83 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.175316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.175316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.175316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.175714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.175714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.175714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.182134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1401/2766] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:17.185932 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.197807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7989522-478e-4ebc-9aa6-9de54bd9bef9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.202663 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.203292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.203576 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.204125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.204766 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.206355 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17a5c5-9a45-4ba4-a4f6-a300147d1a47 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.217722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1366/2767] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:17.221947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.232971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac1d54-2349-476b-8703-ecc651e8d279 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.240056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.240832 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.241163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.241390 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] PATH_INFO: `/v3/projects/62b7dddc22a94ed89ae0d07bf72765a2/users/d6ae315ee9f148e9ada330bf1aac3ce5/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.258137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b7dddc22a94ed89ae0d07bf72765a2, user_id=d6ae315ee9f148e9ada330bf1aac3ce5, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.261601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.274633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1402/2768] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:17 2022] PUT /identity/v3/projects/62b7dddc22a94ed89ae0d07bf72765a2/users/d6ae315ee9f148e9ada330bf1aac3ce5/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:17.285069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.285342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.285617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.317887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] MFA Rules not processed for user `d6ae315ee9f148e9ada330bf1aac3ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:17.319417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:17.339333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:17.388765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1367/2769] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:17.400492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:17.402429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:17.464759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3f793-ab4c-4513-b71c-d3063efe8d7d admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:17.468553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:17.469156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:17.469439 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:17.469710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:17.480156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:17.481618 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3905-a983-4543-9dcf-b2a796210455 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:17.492697 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1403/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:20.102636 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:20.166002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269f894-4678-4744-b8f0-f0a231d61a8a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:20.170509 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:20.171144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.171447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.171724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] PATH_INFO: `/v3/users/d6ae315ee9f148e9ada330bf1aac3ce5` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.172840 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ae315ee9f148e9ada330bf1aac3ce5)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:20.174799 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:20.225144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ae315ee9f148e9ada330bf1aac3ce5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.225833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ae315ee9f148e9ada330bf1aac3ce5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.233519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ae315ee9f148e9ada330bf1aac3ce5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.242286 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ae315ee9f148e9ada330bf1aac3ce5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.242964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ae315ee9f148e9ada330bf1aac3ce5'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.263599 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1368/2771] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:20 2022] DELETE /identity/v3/users/d6ae315ee9f148e9ada330bf1aac3ce5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:20.268379 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.268852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.269115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.289650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:20.290925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:20.351884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1404/2772] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:20.361482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:20.362895 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:20.404926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:20.422812 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e037bde-94d4-468f-a0c4-247b3a848e25 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:20.426521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:20.427850 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.428128 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.428411 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.437671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:20.439101 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772cb14-f643-42c0-8009-f577719b9c09 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:20.448623 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1369/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:20.729642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:20.731297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:20.743742 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56911e-77b9-4957-b207-5df865c62bb4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:20.748820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:20.749525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.749903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.750277 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] PATH_INFO: `/v3/projects/62b7dddc22a94ed89ae0d07bf72765a2` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.751442 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b7dddc22a94ed89ae0d07bf72765a2)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:20.753652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:20.771302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:20.805567 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b7dddc22a94ed89ae0d07bf72765a2', 'request_id': 'req-2f0b3569-f5cd-443e-b1fa-7ca928001b33'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.811137 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b7dddc22a94ed89ae0d07bf72765a2', 'request_id': 'req-2f0b3569-f5cd-443e-b1fa-7ca928001b33'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.818754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b7dddc22a94ed89ae0d07bf72765a2', 'request_id': 'req-2f0b3569-f5cd-443e-b1fa-7ca928001b33'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.830632 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] The token cache is being invalidate because project 62b7dddc22a94ed89ae0d07bf72765a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:20.830992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.831726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2f0b3569-f5cd-443e-b1fa-7ca928001b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:20.833854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1405/2774] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:20 2022] DELETE /identity/v3/projects/62b7dddc22a94ed89ae0d07bf72765a2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:20.838966 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.839291 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.839705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.865814 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:20.866988 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:20.929685 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1370/2775] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:20.939428 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.939801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.940020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.965189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:20.966414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:20.975147 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1406/2776] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:20.979546 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:20.989356 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b56122-e713-48c7-b929-96c7ee638192 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:20.994236 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:20.994843 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:20.995125 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:20.995430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:20.996077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:20.996381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:20.998025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.010401 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1371/2777] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:21.014774 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.025642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbd1ae-1df7-4c38-9b80-9a4915468f75 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.030406 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.031009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.031338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.031615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.032256 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.034168 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.060971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1407/2778] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:21 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:21.065199 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.075770 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f400f-5c23-4ad3-ba7a-013b1210a756 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.131844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.132517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.132619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.132891 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.133505 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.135499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.156873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1372/2779] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:21 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:21.161164 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.171388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209a1d7-4333-43fc-bf7e-07ef541ef998 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.176122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.176730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.177070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.177347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.177970 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.179642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.189488 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1408/2780] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:21.193945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.204147 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1c9c7-ee1a-4916-9bfb-6ad8b4dae59d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.209394 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.209992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.210273 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.210543 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.211195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.212788 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00539d96-d9ba-45bb-a451-1ad61b2f8497 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.223202 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1373/2781] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:21.227341 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.237128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c76dd-cc34-4f4f-8943-be3922516dfe admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.241721 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.242364 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.242639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.242909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] PATH_INFO: `/v3/projects/e30d64f4e8094165bba235e269fa9138/users/c6aed6b0cad64d91b2aa7f31a55f9532/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.257966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30d64f4e8094165bba235e269fa9138, user_id=c6aed6b0cad64d91b2aa7f31a55f9532, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.260695 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.274553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1409/2782] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:21 2022] PUT /identity/v3/projects/e30d64f4e8094165bba235e269fa9138/users/c6aed6b0cad64d91b2aa7f31a55f9532/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:21.279613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.279904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.280174 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.301317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:21.303474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:21.348487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:21.369017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1374/2783] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:21.378671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:21.380448 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:21.441782 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092931-f354-45c8-9433-93a96d3202e7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:21.446191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:21.446801 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:21.447082 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:21.447383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:21.457360 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:21.459425 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae2317-ae4b-468b-bb8e-ff742009309a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:21.468761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1410/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:22.915985 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:22.917881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:22.931499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b16d9e-d941-497d-b2bb-eb1f360f1a76 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:22.944078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:22.944833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:22.945117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:22.945395 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] PATH_INFO: `/v3/users/6d2a34c264aa4607a91292fd7638be19` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:22.946684 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d2a34c264aa4607a91292fd7638be19)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:22.948662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:23.007724 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d2a34c264aa4607a91292fd7638be19'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.008867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d2a34c264aa4607a91292fd7638be19'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.016933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d2a34c264aa4607a91292fd7638be19'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.024925 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d2a34c264aa4607a91292fd7638be19'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.025601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d2a34c264aa4607a91292fd7638be19'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.045559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1375/2785] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:22 2022] DELETE /identity/v3/users/6d2a34c264aa4607a91292fd7638be19 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:23.050083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:23.050554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:23.050759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:23.071859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:23.073229 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:23.142589 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:23.182661 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1411/2786] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:23.195935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:23.197477 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:23.266690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eb17e-2dfc-45aa-91b4-315ae4ca01d5 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:23.271658 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:23.272340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:23.272621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:23.272889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:23.293871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:23.295361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e780678-5e7c-4fae-8f1c-f8cf1792c05e service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:23.305522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1376/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:23.832307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:23.836023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:23.870544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8820e3-90d8-4e02-b3a2-5b37adf089a4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:23.875635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:23.876460 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:23.876745 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:23.877025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] PATH_INFO: `/v3/projects/dee1f1f69ef443558617a4e2956524b5` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:23.878848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee1f1f69ef443558617a4e2956524b5)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:23.880947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:23.938334 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee1f1f69ef443558617a4e2956524b5', 'request_id': 'req-80697755-b610-4a92-bf8e-5f2f6b6d4213'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.945759 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee1f1f69ef443558617a4e2956524b5', 'request_id': 'req-80697755-b610-4a92-bf8e-5f2f6b6d4213'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.956622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee1f1f69ef443558617a4e2956524b5', 'request_id': 'req-80697755-b610-4a92-bf8e-5f2f6b6d4213'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.970111 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] The token cache is being invalidate because project dee1f1f69ef443558617a4e2956524b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:23.970399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.971066 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-80697755-b610-4a92-bf8e-5f2f6b6d4213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:23.972808 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1412/2788] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:23 2022] DELETE /identity/v3/projects/dee1f1f69ef443558617a4e2956524b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:23.978081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:23.978568 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:23.978665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.007058 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:24.008527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:24.112250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1377/2789] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:24.114944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.117370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.117860 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.142047 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:24.143356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:24.156807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1413/2790] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:24.161619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.166956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:24.174577 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7ef3-0a82-4d99-8def-e597e320ba7e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.183529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.184491 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.184956 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.185414 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.186425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:24.186914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.188983 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.220904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.228457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1378/2791] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:24.233083 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a3762-45f9-4882-a2d1-d2c287898d55 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.242432 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.243242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.247687 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.248094 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.248865 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.251978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.307588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1414/2792] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:24 2022] POST /identity/v3/projects => generated 395 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:24.309752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.323529 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee89f46-437a-4179-8094-0eb1cfab9278 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.405725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.406478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.406858 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.407348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.408049 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.410046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.445819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1379/2793] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:24 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:24.449833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.462230 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbeb0e9-7c4c-49c2-93b3-5a7ecdf78ca7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.467056 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.467780 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.468130 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.468468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.469173 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.470887 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.487547 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1415/2794] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:24.488869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.502930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94038a-ebfd-4eb5-9b7c-ab517f035096 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.509288 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.510333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.510846 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.511342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.512760 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.514758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcdc7ae-8a15-4b2e-a5ff-030c39a11940 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.531913 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1380/2795] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:24.536846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.548176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792e599-eabf-4dc0-952a-4af93de6930f admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.562220 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.563069 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.563545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.564275 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] PATH_INFO: `/v3/projects/8b812297b3cf4f3a83fd8f4490165697/users/5762e56c9b804eb2b2a8db08c8dcf6c6/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.596387 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b812297b3cf4f3a83fd8f4490165697, user_id=5762e56c9b804eb2b2a8db08c8dcf6c6, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.600088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.621052 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1416/2796] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:24 2022] PUT /identity/v3/projects/8b812297b3cf4f3a83fd8f4490165697/users/5762e56c9b804eb2b2a8db08c8dcf6c6/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:22:24.631056 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109a67-dcf7-466b-8c75-e4121e6bf054 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.632296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109a67-dcf7-466b-8c75-e4121e6bf054 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.632595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109a67-dcf7-466b-8c75-e4121e6bf054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.666501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-9c109a67-dcf7-466b-8c75-e4121e6bf054 None None] MFA Rules not processed for user `5762e56c9b804eb2b2a8db08c8dcf6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:24.667922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-9c109a67-dcf7-466b-8c75-e4121e6bf054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:24.747196 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1381/2797] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:24.758212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:24.760345 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:24.870930 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faf0b7-8fcd-44c7-bca4-c576b02341e5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:24.877298 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:24.878243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:24.878544 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:24.878821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:24.891413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:24.894212 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:24.920487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1417/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:24 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:26.296993 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.298700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.298700 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.338507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] MFA Rules not processed for user `c6aed6b0cad64d91b2aa7f31a55f9532`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:26.339774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:26.388263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:26.409639 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1382/2799] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:26.415001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.416503 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:26.423063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:26.494947 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b52fc-a956-483a-ae32-7eccc1b34ef8 service cinder] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.499294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.500093 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.500273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.500552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.501176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.503076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.535356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1418/2800] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:26 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:26.539327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.554059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbf686-fbde-46bb-a637-9a4c34e7627f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.636610 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.637327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.637666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.638129 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.638808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.640904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.664853 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1383/2801] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:26 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:22:26.669231 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.683227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6ae57-8351-4474-a21c-8601448adad4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.686351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.687186 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.688316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.688316 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.688628 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.690318 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.703191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1419/2802] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:26.706841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.717945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3519bc5-19ee-4c90-a14e-41784aeed6ff admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.723239 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.725043 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.725330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.725884 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] PATH_INFO: `/v3/projects/055480e227c54bb2950b1d0f5eccef53/users/2bf3791c0c384c5da51a695e4c9f9683/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.749162 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055480e227c54bb2950b1d0f5eccef53, user_id=2bf3791c0c384c5da51a695e4c9f9683, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.753682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.777561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1384/2803] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:26 2022] PUT /identity/v3/projects/055480e227c54bb2950b1d0f5eccef53/users/2bf3791c0c384c5da51a695e4c9f9683/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:26.781625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.796668 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d23c1-3adf-4c00-ac65-111f519e78ae admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.936525 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.937236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.937434 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.937714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.941495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.943968 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.958424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1420/2804] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:26.962626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:26.975406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf008e-e320-4a5a-b94d-de720285d984 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:26.980753 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:26.981565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:26.981914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:26.982519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] PATH_INFO: `/v3/projects/055480e227c54bb2950b1d0f5eccef53/users/2bf3791c0c384c5da51a695e4c9f9683/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:26.984497 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055480e227c54bb2950b1d0f5eccef53, user_id=2bf3791c0c384c5da51a695e4c9f9683, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:26.987211 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba0869-5041-4135-9e68-5b13558b27d0 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:26.999653 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1385/2805] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:26 2022] PUT /identity/v3/projects/055480e227c54bb2950b1d0f5eccef53/users/2bf3791c0c384c5da51a695e4c9f9683/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:30.609464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:30.651698 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e561e-f9e7-4f76-9d92-e0bf1249dc4a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:30.824454 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:30.825174 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:30.825649 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:30.826162 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] PATH_INFO: `/v3/users/5762e56c9b804eb2b2a8db08c8dcf6c6` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:30.837100 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5762e56c9b804eb2b2a8db08c8dcf6c6)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:30.839749 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:30.882960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:30.981310 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5762e56c9b804eb2b2a8db08c8dcf6c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:30.982121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5762e56c9b804eb2b2a8db08c8dcf6c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:30.992988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5762e56c9b804eb2b2a8db08c8dcf6c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:30.993831 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5762e56c9b804eb2b2a8db08c8dcf6c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:31.018901 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5762e56c9b804eb2b2a8db08c8dcf6c6'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:31.048601 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1421/2806] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:30 2022] DELETE /identity/v3/users/5762e56c9b804eb2b2a8db08c8dcf6c6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:31.053377 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:31.054743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:31.055478 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:31.120432 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:31.123661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:31.289957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1386/2807] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:31.290889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:31.292647 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:31.449009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a866e78-9225-4cef-a4e1-ee29673548ad admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:31.453358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:31.454509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:31.454879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:31.455269 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:31.479911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:31.481518 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df43122-6d59-4681-9443-414f9c5f830d service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:31.495393 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1422/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:31.958183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:31.959620 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:31.976237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4ef17-73e6-480a-9f46-d6cf209c8441 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:31.991631 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:31.992549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:31.992864 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:31.993124 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] PATH_INFO: `/v3/projects/8b812297b3cf4f3a83fd8f4490165697` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:31.994758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b812297b3cf4f3a83fd8f4490165697)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:31.997384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:32.087815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:32.099626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b812297b3cf4f3a83fd8f4490165697', 'request_id': 'req-d6871a9c-8a70-4bae-921e-ee5d247b2752'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:32.109085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b812297b3cf4f3a83fd8f4490165697', 'request_id': 'req-d6871a9c-8a70-4bae-921e-ee5d247b2752'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:32.119922 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b812297b3cf4f3a83fd8f4490165697', 'request_id': 'req-d6871a9c-8a70-4bae-921e-ee5d247b2752'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:32.142210 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] The token cache is being invalidate because project 8b812297b3cf4f3a83fd8f4490165697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:32.142561 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:32.143472 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:32.146228 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1387/2809] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:31 2022] DELETE /identity/v3/projects/8b812297b3cf4f3a83fd8f4490165697 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:32.293281 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696835f-aa7a-4271-9eaf-5978992c872c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:32.294265 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696835f-aa7a-4271-9eaf-5978992c872c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:32.294834 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696835f-aa7a-4271-9eaf-5978992c872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:32.332905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-7696835f-aa7a-4271-9eaf-5978992c872c None None] MFA Rules not processed for user `2bf3791c0c384c5da51a695e4c9f9683`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:32.334327 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-7696835f-aa7a-4271-9eaf-5978992c872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:32.428076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1423/2810] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:32.438193 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:32.439708 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:32.521017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6871a9c-8a70-4bae-921e-ee5d247b2752 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:32.527019 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:32.527671 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:32.527948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:32.528248 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:32.530048 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:32.595039 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:32.596772 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:32.607591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1388/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:33.711531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afe6a-bba3-4cfa-b692-6a73f3235e84 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:33.712064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afe6a-bba3-4cfa-b692-6a73f3235e84 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:33.712163 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215afe6a-bba3-4cfa-b692-6a73f3235e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:33.732671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-215afe6a-bba3-4cfa-b692-6a73f3235e84 None None] MFA Rules not processed for user `c6aed6b0cad64d91b2aa7f31a55f9532`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:33.733903 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-215afe6a-bba3-4cfa-b692-6a73f3235e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:33.741842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1424/2812] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:37.404433 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:37.405928 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:37.482337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:37.557829 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60e74-65e6-4177-bb5e-f0e35dac0d29 service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:37.564164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:37.565134 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:37.565573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:37.566064 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] PATH_INFO: `/v3/users/2d09f8fc4754451b8bc4e9709720f9d1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:37.568398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d09f8fc4754451b8bc4e9709720f9d1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:37.570564 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:37.621122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d09f8fc4754451b8bc4e9709720f9d1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:37.622052 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d09f8fc4754451b8bc4e9709720f9d1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:37.637308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d09f8fc4754451b8bc4e9709720f9d1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:37.645949 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d09f8fc4754451b8bc4e9709720f9d1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:37.647289 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d09f8fc4754451b8bc4e9709720f9d1'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:37.668743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1389/2813] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:37 2022] DELETE /identity/v3/users/2d09f8fc4754451b8bc4e9709720f9d1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:37.673510 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:37.674476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:37.674757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:37.722854 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:37.724484 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:37.728716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:37.802208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1425/2814] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:37.809194 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:37.811301 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:37.900573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8ba88-7971-452f-9a3c-1b1edfbe2544 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:37.904155 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:37.904881 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:37.905161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:37.905499 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:37.917145 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:37.918617 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:37.929449 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1390/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:38.211011 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:38.212800 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:38.225408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84817cf-a257-43a5-851e-7d3d8b8d54b4 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:38.231046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:38.231804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:38.232198 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:38.232476 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] PATH_INFO: `/v3/projects/e5bd2e01426d4ab6b17d9cd6b580697b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:38.233812 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bd2e01426d4ab6b17d9cd6b580697b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:38.236048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:38.287241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bd2e01426d4ab6b17d9cd6b580697b', 'request_id': 'req-dab60223-94bd-4993-bbc8-e9e386e1a783'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.293794 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bd2e01426d4ab6b17d9cd6b580697b', 'request_id': 'req-dab60223-94bd-4993-bbc8-e9e386e1a783'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.303324 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bd2e01426d4ab6b17d9cd6b580697b', 'request_id': 'req-dab60223-94bd-4993-bbc8-e9e386e1a783'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.314897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] The token cache is being invalidate because project e5bd2e01426d4ab6b17d9cd6b580697b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:38.315218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.315846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.317351 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1426/2816] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:38 2022] DELETE /identity/v3/projects/e5bd2e01426d4ab6b17d9cd6b580697b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:38.321992 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:38.328170 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:38.332246 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40407-e5fa-4cdb-8b59-dcbaa8072505 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:38.396997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:38.397941 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:38.398415 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:38.398844 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] PATH_INFO: `/v3/users/77fb2d55914a420085ee1d8a77fe00e9` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:38.400295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fb2d55914a420085ee1d8a77fe00e9)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:38.402238 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:38.455654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fb2d55914a420085ee1d8a77fe00e9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.456406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fb2d55914a420085ee1d8a77fe00e9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.471654 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fb2d55914a420085ee1d8a77fe00e9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.480695 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fb2d55914a420085ee1d8a77fe00e9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.481442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-33a43516-ef5e-4970-ae54-7f20b4a1c383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fb2d55914a420085ee1d8a77fe00e9'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.499837 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1391/2817] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:38 2022] DELETE /identity/v3/users/77fb2d55914a420085ee1d8a77fe00e9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:38.800196 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:38.801671 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:38.816680 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab60223-94bd-4993-bbc8-e9e386e1a783 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:38.877807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:38.878441 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:38.878726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:38.879001 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] PATH_INFO: `/v3/projects/1796d454ec14497fb7e8b561f32996ca` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:38.880172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1796d454ec14497fb7e8b561f32996ca)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:38.882133 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:38.923747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:38.936087 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1796d454ec14497fb7e8b561f32996ca', 'request_id': 'req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.941758 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1796d454ec14497fb7e8b561f32996ca', 'request_id': 'req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.949215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1796d454ec14497fb7e8b561f32996ca', 'request_id': 'req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.962049 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] The token cache is being invalidate because project 1796d454ec14497fb7e8b561f32996ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:38.962338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.962985 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-2dd4af8e-1ce4-45c9-945b-6f04bfb6a138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:38.964716 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1427/2818] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:38 2022] DELETE /identity/v3/projects/1796d454ec14497fb7e8b561f32996ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:38.970442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:38.970645 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:38.970953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.021765 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:39.023268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:39.076727 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:39.088381 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1392/2819] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:39.098042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.098042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.098042 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.117958 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:39.119184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:39.127010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1428/2820] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:39.131998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.141565 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577688a4-5d71-4a92-a79c-818464e52e59 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.146802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.147615 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.147902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.148232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.148863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:39.149337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.151345 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.164012 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1393/2821] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:39.168642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.178000 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc22b58-dfd1-41e3-ac30-846d6c10acce None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.182802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.183437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.183722 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.184023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.184660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.186571 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.218146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1429/2822] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:39.221232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.231030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf2917-5085-4ade-8851-8126276fe2d9 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.289961 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.290570 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.290848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.291118 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.291764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.293778 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.314184 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1394/2823] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:39.319127 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.330706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439b352-71be-4b9f-9224-3ca91fc314cc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.336192 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.336802 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.337085 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.337362 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.338007 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.339670 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.349967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1430/2824] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:39.354340 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.364397 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c121da-1b4a-4099-9892-10849810ded7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.369871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.370464 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.370749 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.371025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.371706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.373317 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad943b1b-d5a2-4aff-b8fa-057339882c33 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.387921 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1395/2825] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:39.389820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.400073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a437e-8d32-489b-a244-3c36760c28fc admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.404988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.405663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.405942 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.406213 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] PATH_INFO: `/v3/projects/f1ba054904cb460b9b5c2e58b1c19552/users/174e72a32a60434895235454efbcb416/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.420960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ba054904cb460b9b5c2e58b1c19552, user_id=174e72a32a60434895235454efbcb416, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.423643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.438207 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1431/2826] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:39 2022] PUT /identity/v3/projects/f1ba054904cb460b9b5c2e58b1c19552/users/174e72a32a60434895235454efbcb416/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:39.449968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.450263 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.450547 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.480041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] MFA Rules not processed for user `174e72a32a60434895235454efbcb416`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:39.481253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:39.553721 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1396/2827] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:39.558287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.623108 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a346d2-e33b-4500-b60d-f95118aa9d05 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.628053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.628660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.628935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.629208 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.629859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.632627 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.660317 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1432/2828] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:39.664511 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.676845 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902c7f-f476-4a88-9442-6a9b73c54df9 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.736914 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:39.746450 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.747501 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.747833 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.748107 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.748835 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.752059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.774841 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1397/2829] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:39 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:39.779005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.789963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17cefc-de19-4106-a194-c58a4fbd2db9 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.794634 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.795262 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.795549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.795827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.796464 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.798114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.809237 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1433/2830] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:39.814133 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.825074 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6460f0b-d833-40cc-8da6-9f2067150b2b admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.830072 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.830731 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.831013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.831330 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] PATH_INFO: `/v3/projects/bb502b31a1a948108f156337100899f8/users/6287b3e73fa2491080e166e96b02c608/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.846254 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb502b31a1a948108f156337100899f8, user_id=6287b3e73fa2491080e166e96b02c608, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.848953 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.862144 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1398/2831] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:39 2022] PUT /identity/v3/projects/bb502b31a1a948108f156337100899f8/users/6287b3e73fa2491080e166e96b02c608/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:39.867009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.878507 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b5e77-2ed0-4965-980a-72b93d89802a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.909027 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:39.940825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.941444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.941735 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.942031 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.942678 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.944516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2e915-edcb-4d98-8b6e-458c1b80144c admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.955532 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1434/2832] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:22:39.960120 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:39.970474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309ee99-1900-4d08-806e-8edc4e2f96e4 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:39.975677 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:39.976323 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:39.976603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:39.976878 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] PATH_INFO: `/v3/projects/bb502b31a1a948108f156337100899f8/users/6287b3e73fa2491080e166e96b02c608/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:39.978791 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb502b31a1a948108f156337100899f8, user_id=6287b3e73fa2491080e166e96b02c608, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:39.981807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:39.993071 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1399/2833] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:39 2022] PUT /identity/v3/projects/bb502b31a1a948108f156337100899f8/users/6287b3e73fa2491080e166e96b02c608/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:40.003499 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:40.003820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:40.004099 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:40.034850 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] MFA Rules not processed for user `6287b3e73fa2491080e166e96b02c608`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:40.036118 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:40.107337 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1435/2834] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:40.119666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:40.122403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:40.186365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad9bc-477c-4594-8758-816283564d67 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:40.190046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:40.190648 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:40.190930 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:40.191233 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:40.200886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:40.202649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:40.213905 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1400/2835] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:40.261781 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:40.263516 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:40.278836 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e85252-77bc-459a-b957-b637b729b0ab None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:40.280074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:40.280685 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:40.280967 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:40.281242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:40.352924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:40.354451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72cde3-f2c0-4765-8ef8-4864cbfd8611 service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:40.365948 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1436/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:43.999250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:44.111440 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa07f-1c35-4efe-b58a-9770004f8497 service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:44.118498 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:44.119641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:44.120710 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:44.120802 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] PATH_INFO: `/v3/users/174e72a32a60434895235454efbcb416` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:44.122666 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=174e72a32a60434895235454efbcb416)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:44.125854 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:44.194528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174e72a32a60434895235454efbcb416'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.195625 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174e72a32a60434895235454efbcb416'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.201641 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:44.207474 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174e72a32a60434895235454efbcb416'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.221470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174e72a32a60434895235454efbcb416'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.222539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174e72a32a60434895235454efbcb416'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.252950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1401/2837] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:43 2022] DELETE /identity/v3/users/174e72a32a60434895235454efbcb416 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:44.258350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:44.258889 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:44.258991 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:44.279383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:44.280932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:44.342146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:44.362180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1437/2838] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:44.375065 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:44.377538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:44.441559 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c3d2-a28a-4068-9dc0-3e09d9f40dda admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:44.445964 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:44.446758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:44.447106 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:44.447462 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:44.457979 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:44.459883 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:44.470943 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1402/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:44.788949 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:44.790531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:44.805825 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf66e1-a261-442d-a8a3-d7d01d551450 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:44.811733 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:44.812355 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:44.812642 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:44.812946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] PATH_INFO: `/v3/projects/f1ba054904cb460b9b5c2e58b1c19552` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:44.816146 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ba054904cb460b9b5c2e58b1c19552)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:44.818189 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:44.876396 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ba054904cb460b9b5c2e58b1c19552', 'request_id': 'req-405aada4-a419-4aa9-a227-b66dae85981a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.884151 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ba054904cb460b9b5c2e58b1c19552', 'request_id': 'req-405aada4-a419-4aa9-a227-b66dae85981a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.897368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ba054904cb460b9b5c2e58b1c19552', 'request_id': 'req-405aada4-a419-4aa9-a227-b66dae85981a'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.912662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] The token cache is being invalidate because project f1ba054904cb460b9b5c2e58b1c19552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:44.912963 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.913747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:44.917013 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1438/2840] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:44 2022] DELETE /identity/v3/projects/f1ba054904cb460b9b5c2e58b1c19552 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:44.922407 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:44.935307 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e6e5-3790-4742-abec-b38dee0b861f service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.010945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.011776 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.012117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.012542 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] PATH_INFO: `/v3/users/6287b3e73fa2491080e166e96b02c608` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.013880 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6287b3e73fa2491080e166e96b02c608)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.016130 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.082571 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6287b3e73fa2491080e166e96b02c608'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.083387 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6287b3e73fa2491080e166e96b02c608'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.101808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6287b3e73fa2491080e166e96b02c608'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.119189 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6287b3e73fa2491080e166e96b02c608'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.120709 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4c22a3db-035b-4e25-932b-9d0a9161446d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6287b3e73fa2491080e166e96b02c608'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.135821 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:45.158726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1403/2841] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:44 2022] DELETE /identity/v3/users/6287b3e73fa2491080e166e96b02c608 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:45.474418 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:45.475875 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:45.497325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aada4-a419-4aa9-a227-b66dae85981a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.557830 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.558827 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.559124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.559427 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] PATH_INFO: `/v3/projects/bb502b31a1a948108f156337100899f8` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.560584 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb502b31a1a948108f156337100899f8)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.562767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.616876 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb502b31a1a948108f156337100899f8', 'request_id': 'req-1d895031-16ab-4454-b4fa-58f155e2b2ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.622358 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb502b31a1a948108f156337100899f8', 'request_id': 'req-1d895031-16ab-4454-b4fa-58f155e2b2ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.630211 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb502b31a1a948108f156337100899f8', 'request_id': 'req-1d895031-16ab-4454-b4fa-58f155e2b2ae'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.642255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] The token cache is being invalidate because project bb502b31a1a948108f156337100899f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:45.642548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.643227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-1d895031-16ab-4454-b4fa-58f155e2b2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:45.644730 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1439/2842] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:45 2022] DELETE /identity/v3/projects/bb502b31a1a948108f156337100899f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:45.650113 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.650403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.650680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.673656 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:45.674879 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:45.735787 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1404/2843] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:45.743965 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.744252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.744531 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.759404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:45.765131 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:45.766804 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:45.775552 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1440/2844] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:45.779792 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:45.789664 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e893e-dfa8-42ec-8c19-fb1310dbaae5 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.794117 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.794704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.794978 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.795283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.795911 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81548) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:45.796206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.797827 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.809322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1405/2845] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:45.813646 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:45.823643 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1eb687-e71e-40fc-bffe-61abb631f1f6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.828255 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.829142 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.829420 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.829691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.830321 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.832290 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.859422 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1441/2846] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:45 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:45.863670 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:45.873774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f442f4-967b-43d5-92a4-e754a6c1d309 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.929538 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.930127 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.930404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.930674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.931327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.933318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.955982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1406/2847] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:45 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:45.961132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:45.971560 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b199a13-1b93-4f69-b7fd-7fb77ff0264e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:45.976508 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:45.977120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:45.977405 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:45.977679 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:45.978326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:45.979992 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:45.990279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1442/2848] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:45.994535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.004934 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073b187-272c-4481-ab80-2e62d6faa1aa admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.010890 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.011521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.012062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.012062 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.012697 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.014283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249777b-783c-434c-af25-42f16d3bd514 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.025918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1407/2849] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:46.030191 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.040748 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce0e8-59dd-47dc-9f73-ab5294ac8366 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.045437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.046088 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.046371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.046747 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] PATH_INFO: `/v3/projects/7db3547bc41e434cb69223a2e745e2d7/users/1ed6da8e82924789abbd76c48e0bf80c/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.062936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db3547bc41e434cb69223a2e745e2d7, user_id=1ed6da8e82924789abbd76c48e0bf80c, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.065714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.079521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1443/2850] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:46 2022] PUT /identity/v3/projects/7db3547bc41e434cb69223a2e745e2d7/users/1ed6da8e82924789abbd76c48e0bf80c/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:46.091716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17053-3710-4286-ab01-e17903aa673b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.092001 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17053-3710-4286-ab01-e17903aa673b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.092268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17053-3710-4286-ab01-e17903aa673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.120416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-aab17053-3710-4286-ab01-e17903aa673b None None] MFA Rules not processed for user `1ed6da8e82924789abbd76c48e0bf80c`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:46.121612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-aab17053-3710-4286-ab01-e17903aa673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:46.167261 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:46.188868 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1408/2851] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:46.194276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.258025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5ec25-5b00-4cc6-ab52-e3d7d7e73d76 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.262761 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.263430 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.263711 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.263987 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.264633 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.266556 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.298523 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1444/2852] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:46 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:46.303470 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab17053-3710-4286-ab01-e17903aa673b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.314274 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab17053-3710-4286-ab01-e17903aa673b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.376575 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.377446 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.377729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.378002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.378662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.380865 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.405312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1409/2853] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:46 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:46.409412 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.420424 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea778-4290-49dd-97b3-aead2560d4cf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.425073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.425677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.425960 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.426236 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.426867 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.428553 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.440350 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1445/2854] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:22:46.444740 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.454933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ec4f4-b65b-48c1-87a0-6e49786bf8c1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.460385 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.461034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.461337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.461611 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] PATH_INFO: `/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7/users/df79523625e14797919ee4da7379a280/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.476773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd635cdfffc64f8fb41804df73d5ecc7, user_id=df79523625e14797919ee4da7379a280, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.479424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.493600 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1410/2855] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:46 2022] PUT /identity/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7/users/df79523625e14797919ee4da7379a280/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:46.497807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.508572 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9884-116b-4bf2-9fd4-754492457c85 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.569046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.569693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.569977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.570250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.570891 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.572743 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4f609-02c2-4396-ae67-110f51d906a9 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.584139 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1446/2856] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:46.588874 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.599646 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eea1aa-7750-4b3a-b7b6-9b0b68d11a11 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.604346 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.605002 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.605280 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.605553 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] PATH_INFO: `/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7/users/df79523625e14797919ee4da7379a280/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.607674 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd635cdfffc64f8fb41804df73d5ecc7, user_id=df79523625e14797919ee4da7379a280, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.610796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.621877 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1411/2857] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:46 2022] PUT /identity/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7/users/df79523625e14797919ee4da7379a280/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:22:46.633078 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.633371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.633650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.659852 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:46.663266 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] MFA Rules not processed for user `df79523625e14797919ee4da7379a280`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:46.665024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:46.744533 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1447/2858] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:22:46.755968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.757705 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:46.816461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850ad59-049e-4b96-89ef-af157835321a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.820963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.821567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.821848 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.822122 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:46.831326 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:46.832759 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:46.842998 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1412/2859] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:46.948105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:46.957927 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2146-f61a-4252-af1e-2042f1001312 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:46.961757 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:46.962349 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:46.962624 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:46.962892 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:47.020417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:47.022195 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573099b-e088-4668-95ce-69bc05c3cecb service cinder] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:47.032156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1448/2860] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:47.643006 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:47.645224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:47.694313 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:47.743907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2ff63-6aa0-438f-9a36-17d6223b730d service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:47.749027 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:47.749752 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:47.750024 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:47.750296 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:47.752094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:47.764484 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:47.766085 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:47.778613 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1413/2861] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:48.719575 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:48.720076 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:48.720178 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:48.754016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] MFA Rules not processed for user `1fa0b90d101249b0803066fd7604aa84`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:48.755479 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:48.823064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1449/2862] 10.222.0.20 () {58 vars in 967 bytes} [Mon Sep 19 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:48.845580 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:48.847069 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:48.916314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d1ad-8b6c-4797-9c67-4834ddff826d service placement] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:48.921364 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0a463d7f5db49fe9de8bb390363ba5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:48.921999 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:48.922264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:48.922541 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:48.931419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:48.933110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77023644-94be-4e78-84cc-db68c2a0fd20 service swift] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:48.941657 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1414/2863] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Sep 19 11:22:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 19 11:22:49.691714 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:49.727509 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=100 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:49.771922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d116867-318a-4f66-a758-23d197eb5ccc None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:49.778077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:49.778936 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:49.779409 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:49.779843 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] PATH_INFO: `/v3/users/1ed6da8e82924789abbd76c48e0bf80c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:49.781769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed6da8e82924789abbd76c48e0bf80c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:49.784152 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:49.848091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed6da8e82924789abbd76c48e0bf80c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:49.848879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed6da8e82924789abbd76c48e0bf80c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:49.857848 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed6da8e82924789abbd76c48e0bf80c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:49.859285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed6da8e82924789abbd76c48e0bf80c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:49.868301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed6da8e82924789abbd76c48e0bf80c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:49.889615 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1450/2864] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:49 2022] DELETE /identity/v3/users/1ed6da8e82924789abbd76c48e0bf80c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:49.894195 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:49.894726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:49.894866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:49.918549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:49.922747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:50.040348 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1415/2865] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:50.049988 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:50.051498 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:50.136976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418ac3-670e-4c1e-b9cb-70ffb3beb720 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:50.141706 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:50.142435 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:50.142818 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:50.143218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:50.153806 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:50.155506 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:50.167753 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1451/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:50.825958 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:50.827863 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:50.848161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809b8cd-a4de-4a2c-92b1-45c2d6fac0ec None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:50.854398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:50.856531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:50.856531 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:50.856800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] PATH_INFO: `/v3/projects/7db3547bc41e434cb69223a2e745e2d7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:50.858112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db3547bc41e434cb69223a2e745e2d7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:50.859887 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:50.908365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:50.921216 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db3547bc41e434cb69223a2e745e2d7', 'request_id': 'req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:50.930300 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db3547bc41e434cb69223a2e745e2d7', 'request_id': 'req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:50.939997 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db3547bc41e434cb69223a2e745e2d7', 'request_id': 'req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:50.959341 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] The token cache is being invalidate because project 7db3547bc41e434cb69223a2e745e2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:50.960041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:50.960694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:50.965334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1416/2867] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:50 2022] DELETE /identity/v3/projects/7db3547bc41e434cb69223a2e745e2d7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:50.966400 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:50.992880 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24463be8-5418-4f77-a9c8-d3d9e9a4af7e service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:51.112241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:51.128309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:51.129096 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:51.129504 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:51.129873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] PATH_INFO: `/v3/users/df79523625e14797919ee4da7379a280` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:51.132357 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df79523625e14797919ee4da7379a280)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:51.135020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:51.201554 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df79523625e14797919ee4da7379a280'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.202563 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df79523625e14797919ee4da7379a280'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.213356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df79523625e14797919ee4da7379a280'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.214280 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df79523625e14797919ee4da7379a280'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.223444 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-6a7e1047-3119-41b4-84de-769638bc3e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df79523625e14797919ee4da7379a280'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.247243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1452/2868] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:50 2022] DELETE /identity/v3/users/df79523625e14797919ee4da7379a280 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:51.761237 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:51.762696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:51.786590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7eb8b5-8159-4de8-a0fc-34ade04ea38c admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:51.873722 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:51.875595 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:51.875886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:51.876168 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] PATH_INFO: `/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:51.877473 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd635cdfffc64f8fb41804df73d5ecc7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:51.879344 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:51.947318 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd635cdfffc64f8fb41804df73d5ecc7', 'request_id': 'req-3f3b0839-3a54-471a-b526-775e482c9721'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.955191 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd635cdfffc64f8fb41804df73d5ecc7', 'request_id': 'req-3f3b0839-3a54-471a-b526-775e482c9721'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.961824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd635cdfffc64f8fb41804df73d5ecc7', 'request_id': 'req-3f3b0839-3a54-471a-b526-775e482c9721'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.973555 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] The token cache is being invalidate because project fd635cdfffc64f8fb41804df73d5ecc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:51.973892 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.974556 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-3f3b0839-3a54-471a-b526-775e482c9721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:51.976096 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1417/2869] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:51 2022] DELETE /identity/v3/projects/fd635cdfffc64f8fb41804df73d5ecc7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:51.981184 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965659-451f-4faf-b482-9eda18927015 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:51.982401 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965659-451f-4faf-b482-9eda18927015 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:51.982911 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2965659-451f-4faf-b482-9eda18927015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.015728 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-e2965659-451f-4faf-b482-9eda18927015 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:52.016940 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-e2965659-451f-4faf-b482-9eda18927015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:52.080166 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1453/2870] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:52.088800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.089082 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.089384 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.110271 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:52.111430 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:52.120649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1418/2871] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:52.125048 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2965659-451f-4faf-b482-9eda18927015 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.136144 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2965659-451f-4faf-b482-9eda18927015 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.140855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.141458 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.141740 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.142024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.142660 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:22:52.142961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.144814 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.157578 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1454/2872] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:22:52.162119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.171681 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ba251-d4d8-4d54-8f78-b3b195aac958 None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.176404 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.177535 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.177818 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.178087 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.178896 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.180910 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.215349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1419/2873] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:52 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:22:52.216273 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.228124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8965fa-b930-4e02-ac46-93c454adec5a admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.293997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:52.305652 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.306291 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.306924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.308221 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.309025 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.312303 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.342238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1455/2874] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:52 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:52.346527 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.358869 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a789eba-f364-438b-bbce-c87040bab19f admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.363927 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.364521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.364801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.365276 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.365974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.367649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.379419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1420/2875] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:22:52.383689 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.394446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67994d15-3232-4309-935d-a076436456d3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.401376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.402122 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.402904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.403512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.404314 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.406284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0c2ba-61d0-4d54-ae56-2d6fa39322b8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.419959 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1456/2876] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:52.423981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.434334 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dfc1-d8e4-4bfb-b0ef-33d501275c42 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.440045 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.440926 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.441212 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.441490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] PATH_INFO: `/v3/projects/3177e18abdf043c28c86337cd42b25e0/users/429d657ab1144d19ad1f05ca2d2c9c35/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.454235 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:52.460230 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3177e18abdf043c28c86337cd42b25e0, user_id=429d657ab1144d19ad1f05ca2d2c9c35, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.464361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.484215 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1421/2877] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:52 2022] PUT /identity/v3/projects/3177e18abdf043c28c86337cd42b25e0/users/429d657ab1144d19ad1f05ca2d2c9c35/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:22:52.489238 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073a91-e623-42ea-a368-c0ad8df77e6d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.490878 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073a91-e623-42ea-a368-c0ad8df77e6d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.491183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0073a91-e623-42ea-a368-c0ad8df77e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.517897 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c0073a91-e623-42ea-a368-c0ad8df77e6d None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:52.519338 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c0073a91-e623-42ea-a368-c0ad8df77e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:52.597815 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1457/2878] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:52.634242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:52.636590 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:52.705780 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8747-5b7b-437a-977f-5d6f32fd2db7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:52.710400 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:52.711030 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:52.711342 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:52.711619 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:52.721224 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:52.722679 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:52.733886 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1422/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:53.877250 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:53.877869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:53.877869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:53.912114 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] MFA Rules not processed for user `429d657ab1144d19ad1f05ca2d2c9c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:53.913370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:53.996644 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1458/2880] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:53.997882 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.008826 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01c8b4-9396-413d-9976-6d521e061059 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.013490 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.014164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.014532 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.014873 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.015608 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.017591 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.047819 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1423/2881] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:22:53 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:54.048925 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.060451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d97ccf-6f0d-4a70-804f-f96d953ffd9d None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.120010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.120620 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.120905 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.121182 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.121807 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.123769 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.134128 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:54.149705 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1459/2882] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:22:54 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:22:54.150902 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.162528 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac185d9-60cb-48f8-9bf9-31dafcd2cdc1 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.168161 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.168811 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.169094 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.169366 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.170093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.171748 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.184046 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1424/2883] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:54.187820 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.199268 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecf5c2-5257-4f79-8546-06366053eae3 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.204821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.205489 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.205776 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.206053 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] PATH_INFO: `/v3/projects/bc08fce19db14ac8b31dc64666b27b01/users/45440140bf254ca2b49dfc7aeb340777/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.225545 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08fce19db14ac8b31dc64666b27b01, user_id=45440140bf254ca2b49dfc7aeb340777, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.227884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.251072 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1460/2884] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:54 2022] PUT /identity/v3/projects/bc08fce19db14ac8b31dc64666b27b01/users/45440140bf254ca2b49dfc7aeb340777/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:54.253241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.270023 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1ec5-ba21-475d-ad65-55e95528fbe8 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.347716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.349500 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.349981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.350406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.351268 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.355815 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c3773-dda5-4aa7-84ea-77cf806bc812 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.379730 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1425/2885] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:22:54.383383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:54.399467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ebaf-f33f-4a7f-9986-df5b74f4195e admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:54.411132 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:54.413033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] REQUEST_METHOD: `PUT` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:54.413978 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:54.414450 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] PATH_INFO: `/v3/projects/bc08fce19db14ac8b31dc64666b27b01/users/45440140bf254ca2b49dfc7aeb340777/roles/776f1e2ca524448593a9fae01b68a6f1` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:54.417102 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc08fce19db14ac8b31dc64666b27b01, user_id=45440140bf254ca2b49dfc7aeb340777, role_id=776f1e2ca524448593a9fae01b68a6f1)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:54.423399 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579881d3-6c36-428d-9375-485c803e333e admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:54.441953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1461/2886] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:22:54 2022] PUT /identity/v3/projects/bc08fce19db14ac8b31dc64666b27b01/users/45440140bf254ca2b49dfc7aeb340777/roles/776f1e2ca524448593a9fae01b68a6f1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 19 11:22:55.543454 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:55.543982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:55.544081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:55.573870 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] MFA Rules not processed for user `45440140bf254ca2b49dfc7aeb340777`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:55.574866 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:55.628686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:55.658424 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1426/2887] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:55.670014 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:55.670846 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:55.671125 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:55.691383 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] MFA Rules not processed for user `429d657ab1144d19ad1f05ca2d2c9c35`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:22:55.693134 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:55.757217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1462/2888] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:22:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:22:55.768519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:55.770034 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:55.890115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013cad5-2af7-4ace-944e-370a4726dd2d None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:55.907660 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:55.909726 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:55.910475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:55.914214 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:55.923723 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:55.925507 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:55.939035 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1427/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:57.858033 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:57.860356 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:57.938022 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a54080-51b3-420b-bef0-caa6e0e4636b None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:57.944242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:57.944879 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:57.945159 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:57.945431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] PATH_INFO: `/v3/users/c1e1f0b97ad54efebb8a3cb01e85a34c` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:57.946592 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e1f0b97ad54efebb8a3cb01e85a34c)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:57.948565 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:57.998225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e1f0b97ad54efebb8a3cb01e85a34c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:57.998954 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e1f0b97ad54efebb8a3cb01e85a34c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.007437 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e1f0b97ad54efebb8a3cb01e85a34c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.008135 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e1f0b97ad54efebb8a3cb01e85a34c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.015924 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e1f0b97ad54efebb8a3cb01e85a34c'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.017227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:58.038648 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1463/2890] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:57 2022] DELETE /identity/v3/users/c1e1f0b97ad54efebb8a3cb01e85a34c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:58.311513 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:58.326067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed471cc7-5cf8-4a05-b1f1-0e2c7028eb81 service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:58.414704 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:58.415534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:58.415931 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:58.416311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] PATH_INFO: `/v3/projects/98bed0f2138b416c9e27d1b3cc8ca5c4` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:58.417517 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bed0f2138b416c9e27d1b3cc8ca5c4)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:58.419747 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:58.482939 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bed0f2138b416c9e27d1b3cc8ca5c4', 'request_id': 'req-4d29c347-f28f-4425-83a9-0b2151b10079'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.485900 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:58.502240 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bed0f2138b416c9e27d1b3cc8ca5c4', 'request_id': 'req-4d29c347-f28f-4425-83a9-0b2151b10079'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.512549 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bed0f2138b416c9e27d1b3cc8ca5c4', 'request_id': 'req-4d29c347-f28f-4425-83a9-0b2151b10079'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.531519 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] The token cache is being invalidate because project 98bed0f2138b416c9e27d1b3cc8ca5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:58.531907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.533668 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.537041 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1428/2891] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:58 2022] DELETE /identity/v3/projects/98bed0f2138b416c9e27d1b3cc8ca5c4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:58.542467 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:58.544591 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:58.569789 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87a32-463a-4811-9e9b-064ae8570ae1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:58.593872 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:58.595416 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:58.645120 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:58.646655 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:58.647009 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:58.647845 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] PATH_INFO: `/v3/users/1bb9ffb70bb8419dbd0400204d86578e` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:58.649242 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb9ffb70bb8419dbd0400204d86578e)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:58.652034 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:58.719714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29c347-f28f-4425-83a9-0b2151b10079 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:58.723769 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:58.725807 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:58.726088 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:58.726370 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:58.728398 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:58.730777 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb9ffb70bb8419dbd0400204d86578e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.731677 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb9ffb70bb8419dbd0400204d86578e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.742666 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb9ffb70bb8419dbd0400204d86578e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.743921 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb9ffb70bb8419dbd0400204d86578e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.754243 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb9ffb70bb8419dbd0400204d86578e'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:58.778155 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1464/2892] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:22:58 2022] DELETE /identity/v3/users/1bb9ffb70bb8419dbd0400204d86578e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:22:58.823661 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:58.826160 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:58.843244 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1429/2893] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:22:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:22:59.170496 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:22:59.178217 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:22:59.309726 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b530e-d8c5-493f-a04f-1eaa9b2ee330 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:22:59.315608 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:22:59.316436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:22:59.316793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:22:59.317309 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] PATH_INFO: `/v3/projects/c42428e62fe243c0980e5c121c52a20b` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:22:59.319301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42428e62fe243c0980e5c121c52a20b)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:22:59.321569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:22:59.323750 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:59.384325 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42428e62fe243c0980e5c121c52a20b', 'request_id': 'req-100e591a-020d-4886-b035-826f4f59f1b1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:59.390896 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42428e62fe243c0980e5c121c52a20b', 'request_id': 'req-100e591a-020d-4886-b035-826f4f59f1b1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:59.401347 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42428e62fe243c0980e5c121c52a20b', 'request_id': 'req-100e591a-020d-4886-b035-826f4f59f1b1'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:59.415451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] The token cache is being invalidate because project c42428e62fe243c0980e5c121c52a20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:22:59.415765 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:59.416468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:22:59.418527 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1465/2894] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:22:59 2022] DELETE /identity/v3/projects/c42428e62fe243c0980e5c121c52a20b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:08.837735 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=65 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:09.414495 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:10.408372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:10.409774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:10.491081 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe463e3-2034-4e74-a728-3dadd3212c20 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:10.541665 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:10.542277 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:10.542560 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:10.542834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:10.544680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:10.607899 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:10.609264 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:10.619311 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1430/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:20.614832 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=79 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:30.451059 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:30.452610 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:30.517417 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e591a-020d-4886-b035-826f4f59f1b1 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:30.522622 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:30.523293 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:30.523581 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:30.523883 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] PATH_INFO: `/v3/users/429d657ab1144d19ad1f05ca2d2c9c35` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:30.525039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=429d657ab1144d19ad1f05ca2d2c9c35)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:30.526975 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:30.572376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429d657ab1144d19ad1f05ca2d2c9c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.573015 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429d657ab1144d19ad1f05ca2d2c9c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.580414 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429d657ab1144d19ad1f05ca2d2c9c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.581077 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429d657ab1144d19ad1f05ca2d2c9c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.588176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429d657ab1144d19ad1f05ca2d2c9c35'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.605378 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1466/2896] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:23:30 2022] DELETE /identity/v3/users/429d657ab1144d19ad1f05ca2d2c9c35 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:30.782208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:30.793406 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3d783-9380-4545-835c-cabab977184c service cinder] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:30.852040 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:30.852594 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:30.852875 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:30.853150 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] PATH_INFO: `/v3/projects/3177e18abdf043c28c86337cd42b25e0` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:30.854284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3177e18abdf043c28c86337cd42b25e0)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:30.856253 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:30.902482 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3177e18abdf043c28c86337cd42b25e0', 'request_id': 'req-6bebdfea-b810-452f-ba60-3e54fc300c52'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.909110 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3177e18abdf043c28c86337cd42b25e0', 'request_id': 'req-6bebdfea-b810-452f-ba60-3e54fc300c52'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.915551 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3177e18abdf043c28c86337cd42b25e0', 'request_id': 'req-6bebdfea-b810-452f-ba60-3e54fc300c52'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.927173 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] The token cache is being invalidate because project 3177e18abdf043c28c86337cd42b25e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:23:30.927481 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.928142 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:30.929596 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1431/2897] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:23:30 2022] DELETE /identity/v3/projects/3177e18abdf043c28c86337cd42b25e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:30.933603 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:30.934997 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:30.949395 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17493e0a-8603-4dbe-a39e-cd28b3746aba admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.005005 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.005625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.005907 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.006183 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] PATH_INFO: `/v3/users/45440140bf254ca2b49dfc7aeb340777` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.007342 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45440140bf254ca2b49dfc7aeb340777)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.009279 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.031061 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:31.057710 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45440140bf254ca2b49dfc7aeb340777'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.058376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45440140bf254ca2b49dfc7aeb340777'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.065917 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45440140bf254ca2b49dfc7aeb340777'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.066585 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45440140bf254ca2b49dfc7aeb340777'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.073863 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-abe87675-7556-410a-a227-04f81a0ddab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45440140bf254ca2b49dfc7aeb340777'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.091105 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1467/2898] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:23:30 2022] DELETE /identity/v3/users/45440140bf254ca2b49dfc7aeb340777 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:31.261702 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.263241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:31.276690 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebdfea-b810-452f-ba60-3e54fc300c52 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.336333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.336968 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.337251 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.337525 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] PATH_INFO: `/v3/projects/bc08fce19db14ac8b31dc64666b27b01` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.338642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc08fce19db14ac8b31dc64666b27b01)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.340638 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.376950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:31.391434 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc08fce19db14ac8b31dc64666b27b01', 'request_id': 'req-841676e1-9ff0-49ba-a809-4fb10877673e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.399061 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc08fce19db14ac8b31dc64666b27b01', 'request_id': 'req-841676e1-9ff0-49ba-a809-4fb10877673e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.404777 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc08fce19db14ac8b31dc64666b27b01', 'request_id': 'req-841676e1-9ff0-49ba-a809-4fb10877673e'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.416365 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] The token cache is being invalidate because project bc08fce19db14ac8b31dc64666b27b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:23:31.416655 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.417295 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-841676e1-9ff0-49ba-a809-4fb10877673e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:31.418773 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1432/2899] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:23:31 2022] DELETE /identity/v3/projects/bc08fce19db14ac8b31dc64666b27b01 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:31.423625 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.423915 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.424190 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.444483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:31.445751 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:31.505446 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1468/2900] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:31.513154 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.513444 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.513720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.533990 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:31.535372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:31.543712 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1433/2901] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:31.547966 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.558045 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9926944-d564-44b4-b718-bbd6ab74c59a None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.562609 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.563234 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.563521 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.563793 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.564431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:23:31.564754 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.566893 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.578465 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1469/2902] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 19 11:23:31.583554 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.593008 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c362de-7cce-4d77-8730-372d7c358a0b None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.597743 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.598471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.598737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.599010 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.599706 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.601612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.628090 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1434/2903] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:23:31.632935 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.642977 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7347187-8ac3-43e2-a678-fa2da30f41e5 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.715180 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.715809 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.716090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.716369 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.716996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.719008 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.740214 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1470/2904] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 19 11:23:31.745068 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.756315 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84366-3703-4482-be24-305e0195b70d admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.761234 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.761796 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.762067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.762337 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.762963 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.764593 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.774957 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1435/2905] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 19 11:23:31.778886 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.788884 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefea9e-2819-414e-a24a-e617582cc5b4 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.793501 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.794090 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.794368 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.794640 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.795319 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.796945 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab73e6-4eaf-4ce3-9fa1-ff2ee1a8d5c8 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.807599 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1471/2906] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:23:31.811737 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.822278 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92b616-917f-4fce-9b5f-c37135fe16bd admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:31.826908 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:31.827592 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.827871 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.828143 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] PATH_INFO: `/v3/projects/4e6ce86bebfd47739b14947dbed130c7/users/e467c6e661254c9b97a84e4398c71d96/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.843466 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6ce86bebfd47739b14947dbed130c7, user_id=e467c6e661254c9b97a84e4398c71d96, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:31.846115 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:31.858959 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1436/2907] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:23:31 2022] PUT /identity/v3/projects/4e6ce86bebfd47739b14947dbed130c7/users/e467c6e661254c9b97a84e4398c71d96/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:31.870593 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:31.870882 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:31.871179 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:31.879805 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:31.900154 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] MFA Rules not processed for user `e467c6e661254c9b97a84e4398c71d96`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:31.901297 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:31.966837 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1472/2908] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:31.980157 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:31.982013 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:32.039255 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aafab3-e1e3-4e23-9200-c8368f6d1a83 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:32.043789 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:32.044510 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:32.044867 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:32.045159 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:32.054447 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:32.055912 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9f31a-0b73-4fc5-ad27-bfd7a6d502d5 service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:32.065419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1437/2909] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:37.399548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:37.463436 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1ccfc-3c94-4db3-92d2-06e733e5dda6 None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:37.468188 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:37.468821 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:37.469098 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:37.469371 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] PATH_INFO: `/v3/users/e467c6e661254c9b97a84e4398c71d96` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:37.470492 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e467c6e661254c9b97a84e4398c71d96)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:37.473117 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:37.518289 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e467c6e661254c9b97a84e4398c71d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:37.518996 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e467c6e661254c9b97a84e4398c71d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:37.526932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e467c6e661254c9b97a84e4398c71d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:37.527569 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e467c6e661254c9b97a84e4398c71d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:37.534487 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e467c6e661254c9b97a84e4398c71d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:37.552171 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1473/2910] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:23:37 2022] DELETE /identity/v3/users/e467c6e661254c9b97a84e4398c71d96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:37.556612 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:37.557097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:37.557221 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:37.576729 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:37.577933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:37.631471 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:37.642574 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1438/2911] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:37.652803 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:37.654285 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:37.668645 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:37.714124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34444ed-607a-44fd-a5bb-c1b6735ad0d7 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:37.717766 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:37.718370 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:37.718654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:37.718928 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:37.727869 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:37.729329 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3efb07-e805-425e-ad0b-bb0721ce561a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:37.748029 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1474/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:38.016283 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.017758 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.030714 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8e20c-67e7-4b2b-aec9-1bb5d4111e3e None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.035475 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.036112 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.036390 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.036662 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] PATH_INFO: `/v3/projects/4e6ce86bebfd47739b14947dbed130c7` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.037786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6ce86bebfd47739b14947dbed130c7)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.039732 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.088800 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6ce86bebfd47739b14947dbed130c7', 'request_id': 'req-ad45bf37-bf03-4890-90ce-9a3b561c2c00'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.095948 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6ce86bebfd47739b14947dbed130c7', 'request_id': 'req-ad45bf37-bf03-4890-90ce-9a3b561c2c00'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.102250 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6ce86bebfd47739b14947dbed130c7', 'request_id': 'req-ad45bf37-bf03-4890-90ce-9a3b561c2c00'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.113686 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] The token cache is being invalidate because project 4e6ce86bebfd47739b14947dbed130c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:23:38.113974 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.114703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-ad45bf37-bf03-4890-90ce-9a3b561c2c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.116206 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1439/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:23:38 2022] DELETE /identity/v3/projects/4e6ce86bebfd47739b14947dbed130c7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:38.121124 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.121413 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.121691 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.141953 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:38.143202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.203323 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1475/2914] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 19 11:23:38.213720 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.214025 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.214285 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.235205 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:38.236465 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.245164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1440/2915] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:38.249828 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.260859 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc9a47-ab85-483c-9235-8f6d6e6f611c None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.265483 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.266109 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.266392 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.266662 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.267335 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81549) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 19 11:23:38.267635 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.269276 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.285367 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1476/2916] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Sep 19 11:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 19 11:23:38.289522 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.299000 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f46675-a2df-4709-ac16-9df17d385e1a None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.304419 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.305028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.305308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.305603 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] PATH_INFO: `/v3/projects` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.306312 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.308284 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.336461 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1441/2917] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:23:38.340862 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.351511 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53d87b-3345-4991-90e6-0beeb8ebc956 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.415976 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.416736 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.417074 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.417374 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] PATH_INFO: `/v3/users` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.418010 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.419971 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.446372 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1477/2918] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 19 11:23:38.451038 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.462164 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac757-161f-43a2-8a7e-b33a71004384 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.466889 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.467521 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.467804 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.468077 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.468707 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.470308 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.480626 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1442/2919] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:23:38.484637 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.495340 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf754-64b1-4b6f-9460-55cf7203f9bf admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.500073 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.500665 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.500946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.501218 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] PATH_INFO: `/v3/roles` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.501853 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.503529 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc24c95-9a25-4ec2-8b4f-1da37f974013 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.514110 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1478/2920] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Sep 19 11:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 19 11:23:38.518217 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.528483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed7852-6113-4c75-a997-cbf26874d6e7 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.533504 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.534176 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.534459 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.535363 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] PATH_INFO: `/v3/projects/61b4c9b3efe7449e9ff06eeeeefb8ec8/users/d7189f36230f405c9b221630422a8e28/roles/e5e91b1cac4f4f8fb40ee79ea309e120` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.549907 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b4c9b3efe7449e9ff06eeeeefb8ec8, user_id=d7189f36230f405c9b221630422a8e28, role_id=e5e91b1cac4f4f8fb40ee79ea309e120)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.553241 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.566095 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1443/2921] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Sep 19 11:23:38 2022] PUT /identity/v3/projects/61b4c9b3efe7449e9ff06eeeeefb8ec8/users/d7189f36230f405c9b221630422a8e28/roles/e5e91b1cac4f4f8fb40ee79ea309e120 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:38.576639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] REQUEST_METHOD: `POST` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.577006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.577264 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.606336 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.auth.core [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] MFA Rules not processed for user `d7189f36230f405c9b221630422a8e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81549) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:38.607478 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.617202 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:38.676873 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1479/2922] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:38.688183 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.689885 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.746904 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87893e19-bcf0-4214-b4d7-ab8816db2e45 admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.750567 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7968f762514f42df8264f5cbd1eb37ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.751201 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.751487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.751764 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.760328 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.762017 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3935-8643-4673-a7b6-839884083b1a service cinder] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.771834 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1444/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:38.797475 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:38.860468 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab98ee-39ff-4cd6-b50d-31436ff5e64e None None] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:38.865095 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:38.865725 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.866006 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.866284 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] PATH_INFO: `/v3/users/d7189f36230f405c9b221630422a8e28` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.867455 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7189f36230f405c9b221630422a8e28)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:38.869380 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:38.914429 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7189f36230f405c9b221630422a8e28'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.915091 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7189f36230f405c9b221630422a8e28'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.922296 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7189f36230f405c9b221630422a8e28'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.923063 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7189f36230f405c9b221630422a8e28'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.930404 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7189f36230f405c9b221630422a8e28'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:38.947641 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1480/2924] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:23:38 2022] DELETE /identity/v3/users/d7189f36230f405c9b221630422a8e28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:38.952167 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] REQUEST_METHOD: `POST` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:38.952457 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:38.952733 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:38.974349 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.auth.core [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] MFA Rules not processed for user `a9af0f6bd80b4ed4bd5f3775fe6e3d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81548) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 19 11:23:38.975876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:38.993084 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:39.037437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1445/2925] 10.222.0.20 () {58 vars in 958 bytes} [Mon Sep 19 11:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 19 11:23:39.047149 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:39.048639 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:39.084457 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:39.109252 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53388970-fe9a-44b5-b1ad-59f7abf64e57 admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:39.113115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:39.113833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:39.114115 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:39.114388 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:39.123657 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:39.125106 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:39.135064 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1481/2926] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:23:39.414097 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:23:39.415698 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:23:39.428563 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0c6e9-6855-4766-84c8-a962b80da60f None None] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:23:39.434425 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:23:39.435119 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:23:39.435441 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:23:39.435715 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] PATH_INFO: `/v3/projects/61b4c9b3efe7449e9ff06eeeeefb8ec8` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:23:39.437451 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b4c9b3efe7449e9ff06eeeeefb8ec8)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:23:39.439694 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:23:39.487589 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b4c9b3efe7449e9ff06eeeeefb8ec8', 'request_id': 'req-0c332df3-2133-4586-b5d2-c201bbd817ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:39.495659 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b4c9b3efe7449e9ff06eeeeefb8ec8', 'request_id': 'req-0c332df3-2133-4586-b5d2-c201bbd817ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:39.501093 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b4c9b3efe7449e9ff06eeeeefb8ec8', 'request_id': 'req-0c332df3-2133-4586-b5d2-c201bbd817ab'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:39.512862 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] The token cache is being invalidate because project 61b4c9b3efe7449e9ff06eeeeefb8ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81548) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:23:39.513149 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:39.513786 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:23:39.515292 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1446/2927] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:23:39 2022] DELETE /identity/v3/projects/61b4c9b3efe7449e9ff06eeeeefb8ec8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:23:49.130855 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=12 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:49.509824 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:55.365200 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:24:55.374463 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f0357-0485-4264-8c30-d2dc2bab0864 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:24:55.424225 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:24:55.424741 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:24:55.425020 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:24:55.425294 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:24:55.427070 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:24:55.501376 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:24:55.502833 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:24:55.514602 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1482/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:24:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:24:56.740876 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:24:56.742442 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:24:56.755059 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c332df3-2133-4586-b5d2-c201bbd817ab admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:24:56.758784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:24:56.759417 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:24:56.759696 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:24:56.759982 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:24:56.761725 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:24:56.777682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:24:56.779383 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:24:56.792297 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1447/2929] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:24:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:05.508944 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=54 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:06.786689 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:09.884366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:09.894577 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8d3f1-2e80-4c7e-a2e4-580883267d06 service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:09.898322 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:09.898932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:09.899898 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:09.900187 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:09.901961 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:09.912548 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:09.914017 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:09.923756 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1483/2930] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 19 11:25:10.030971 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:10.032933 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:10.045539 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007df83f-b29a-4b77-b36d-377b89663126 service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:10.049642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:10.050259 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:10.050534 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:10.050808 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:10.052640 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:10.069518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:10.071028 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:10.082918 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1448/2931] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:10.144654 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:10.146046 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:10.217885 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4aaf1-38d9-4f7d-8029-990d6700eb3a service neutron] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:10.223024 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:10.223663 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:10.223943 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:10.224215 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:10.225980 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:10.238121 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:10.239752 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:10.250038 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1484/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:20.077524 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:20.246032 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=38 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:46.986634 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:25:46.995327 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a83817-f425-4776-adb7-66713311856a service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:25:46.999042 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478e89a2c7c74b65a7008a49b08ef93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:25:46.999682 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:25:46.999981 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:25:47.000861 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:25:47.002601 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:25:47.012703 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:25:47.014141 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:25:47.022242 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1449/2933] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:25:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:25:57.018621 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=6 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:25.616016 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:25.617693 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.636946 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa84a91-d810-40ae-8475-c0cc894151f7 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:25.644222 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:25.644932 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:25.645278 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:25.645623 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:25.647485 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:25.661307 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:25.663018 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:25.674658 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1485/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:27.746362 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:27.765587 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1b0e8-c2fe-4a0e-a5fc-e565ccf1770c service neutron] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:27.774487 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8f507682b7f425ba842a46ad98d9dae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:27.775597 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:27.776935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:27.776935 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:27.778929 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:27.792536 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:27.794518 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:27.806717 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1450/2935] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:32.318983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:32.334561 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1e715-f2b5-48b3-a819-3c9650752298 service nova] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:32.346039 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:32.346912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] REQUEST_METHOD: `GET` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:32.347326 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:32.347500 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:32.351938 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:32.365408 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:32.367302 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:32.385909 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1486/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:26:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:26:35.563322 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:35.565650 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:35.638011 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bf779-306a-4609-b97c-45b6bdee4552 service nova] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:35.643609 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.644209 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.644566 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.645020 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] PATH_INFO: `/v3/users/c6aed6b0cad64d91b2aa7f31a55f9532` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:35.646178 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6aed6b0cad64d91b2aa7f31a55f9532)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:35.648624 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:35.703232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6aed6b0cad64d91b2aa7f31a55f9532'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.706314 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6aed6b0cad64d91b2aa7f31a55f9532'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.714573 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6aed6b0cad64d91b2aa7f31a55f9532'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.725716 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6aed6b0cad64d91b2aa7f31a55f9532'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.726399 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6aed6b0cad64d91b2aa7f31a55f9532'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:35.747232 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1451/2937] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:35 2022] DELETE /identity/v3/users/c6aed6b0cad64d91b2aa7f31a55f9532 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:35.927588 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:35.939176 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a1123-802a-464d-8f99-24bfe6e8e7f6 service placement] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:35.998431 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:35.998983 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:35.999301 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:35.999767 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] PATH_INFO: `/v3/projects/e30d64f4e8094165bba235e269fa9138` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.000979 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30d64f4e8094165bba235e269fa9138)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.002904 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.052912 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30d64f4e8094165bba235e269fa9138', 'request_id': 'req-4d93200e-0930-4224-a0cd-2751c51b1b5b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.058366 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30d64f4e8094165bba235e269fa9138', 'request_id': 'req-4d93200e-0930-4224-a0cd-2751c51b1b5b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.065451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30d64f4e8094165bba235e269fa9138', 'request_id': 'req-4d93200e-0930-4224-a0cd-2751c51b1b5b'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.076922 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] The token cache is being invalidate because project e30d64f4e8094165bba235e269fa9138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:36.077227 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.078611 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.080512 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1487/2938] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:35 2022] DELETE /identity/v3/projects/e30d64f4e8094165bba235e269fa9138 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:36.085208 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:36.086701 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.100324 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee3295-5ca4-48f6-87ba-43337c3f7bee admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:36.159774 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:36.160403 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.160680 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.160950 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] PATH_INFO: `/v3/users/2bf3791c0c384c5da51a695e4c9f9683` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.162067 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf3791c0c384c5da51a695e4c9f9683)` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.164005 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.169361 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:36.214801 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf3791c0c384c5da51a695e4c9f9683'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.215483 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf3791c0c384c5da51a695e4c9f9683'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.223649 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf3791c0c384c5da51a695e4c9f9683'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.230604 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf3791c0c384c5da51a695e4c9f9683'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.231287 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.notifications [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf3791c0c384c5da51a695e4c9f9683'} {{(pid=81548) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.248784 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1452/2939] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Sep 19 11:26:36 2022] DELETE /identity/v3/users/2bf3791c0c384c5da51a695e4c9f9683 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:36.430559 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Authenticating user token {{(pid=81549) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:26:36.432023 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.fernet_utils [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81549) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:26:36.452287 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93200e-0930-4224-a0cd-2751c51b1b5b admin admin] Validating token access rules against request {{(pid=81549) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:26:36.510990 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9af0f6bd80b4ed4bd5f3775fe6e3d3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba438247ac1f43808755e10d7725b064', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81549) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:26:36.511558 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:26:36.511842 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:26:36.512119 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] PATH_INFO: `/v3/projects/055480e227c54bb2950b1d0f5eccef53` {{(pid=81549) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:26:36.513241 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055480e227c54bb2950b1d0f5eccef53)` {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:26:36.515172 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] RBAC: Authorization granted {{(pid=81549) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:26:36.522477 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:36.564900 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055480e227c54bb2950b1d0f5eccef53', 'request_id': 'req-84c43f41-9cd9-47f4-86df-9c1a18465d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.570546 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055480e227c54bb2950b1d0f5eccef53', 'request_id': 'req-84c43f41-9cd9-47f4-86df-9c1a18465d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.579451 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055480e227c54bb2950b1d0f5eccef53', 'request_id': 'req-84c43f41-9cd9-47f4-86df-9c1a18465d96'} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.590619 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] The token cache is being invalidate because project 055480e227c54bb2950b1d0f5eccef53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81549) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 19 11:26:36.590899 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.591549 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG keystone.notifications [None req-84c43f41-9cd9-47f4-86df-9c1a18465d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81549) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 19 11:26:36.593156 dv-cinder-822822-7-smb devstack@keystone.service[81549]: [pid: 81549|app: 0|req: 1488/2940] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Sep 19 11:26:36 2022] DELETE /identity/v3/projects/055480e227c54bb2950b1d0f5eccef53 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 19 11:26:46.245303 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:46.587650 dv-cinder-822822-7-smb devstack@keystone.service[81549]: DEBUG dbcounter [-] [81549] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:56.267642 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Authenticating user token {{(pid=81548) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 19 11:27:56.269078 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:56.341420 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44785774-4b2b-4a01-962b-684eb70c017a admin admin] Validating token access rules against request {{(pid=81548) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 19 11:27:56.402132 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13f59c80064f44f59abc5defb5515fd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b183d5255b80400ba5b8ab006def60cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81548) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 19 11:27:56.402739 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] REQUEST_METHOD: `GET` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 19 11:27:56.403022 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 19 11:27:56.403333 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81548) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 19 11:27:56.405083 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.fernet_utils [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81548) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 19 11:27:56.416372 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 19 11:27:56.417945 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb896ef-a07a-4e0a-985c-89940c5998a4 service placement] RBAC: Authorization granted {{(pid=81548) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 19 11:27:56.427744 dv-cinder-822822-7-smb devstack@keystone.service[81548]: [pid: 81548|app: 0|req: 1453/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Sep 19 11:27:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 19 11:28:06.423437 dv-cinder-822822-7-smb devstack@keystone.service[81548]: DEBUG dbcounter [-] [81548] Writing DB stats keystone:SELECT=58 {{(pid=81548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}